-- Logs begin at Mon 2022-09-26 11:39:24 UTC, end at Mon 2022-09-26 12:57:25 UTC. -- Sep 26 12:11:30.980454 dv-cinder-827624-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 26 12:11:30.991904 dv-cinder-827624-1-smb devstack@keystone.service[81691]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 12:11:30 2022] *** Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: nodename: dv-cinder-827624-1-smb Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: machine: x86_64 Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: clock source: unix Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: pcre jit disabled Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: detected number of CPU cores: 4 Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: current working directory: / Sep 26 12:11:30.993888 dv-cinder-827624-1-smb devstack@keystone.service[81691]: detected binary path: /usr/bin/uwsgi-core Sep 26 12:11:30.994542 dv-cinder-827624-1-smb devstack@keystone.service[81691]: your processes number limit is 47680 Sep 26 12:11:30.994542 dv-cinder-827624-1-smb devstack@keystone.service[81691]: your memory page size is 4096 bytes Sep 26 12:11:30.994542 dv-cinder-827624-1-smb devstack@keystone.service[81691]: detected max file descriptor number: 2048 Sep 26 12:11:30.994542 dv-cinder-827624-1-smb devstack@keystone.service[81691]: lock engine: pthread robust mutexes Sep 26 12:11:30.994542 dv-cinder-827624-1-smb devstack@keystone.service[81691]: thunder lock: enabled Sep 26 12:11:30.994542 dv-cinder-827624-1-smb devstack@keystone.service[81691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 26 12:11:30.994542 dv-cinder-827624-1-smb devstack@keystone.service[81691]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 12:11:31.042806 dv-cinder-827624-1-smb devstack@keystone.service[81691]: Python main interpreter initialized at 0x564394c2b9c0 Sep 26 12:11:31.042806 dv-cinder-827624-1-smb devstack@keystone.service[81691]: python threads support enabled Sep 26 12:11:31.042806 dv-cinder-827624-1-smb devstack@keystone.service[81691]: your server socket listen backlog is limited to 100 connections Sep 26 12:11:31.042806 dv-cinder-827624-1-smb devstack@keystone.service[81691]: your mercy for graceful operations on workers is 90 seconds Sep 26 12:11:31.043207 dv-cinder-827624-1-smb devstack@keystone.service[81691]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 12:11:31.043285 dv-cinder-827624-1-smb devstack@keystone.service[81691]: *** Operational MODE: preforking *** Sep 26 12:11:31.043539 dv-cinder-827624-1-smb devstack@keystone.service[81691]: *** uWSGI is running in multiple interpreter mode *** Sep 26 12:11:31.043539 dv-cinder-827624-1-smb devstack@keystone.service[81691]: spawned uWSGI master process (pid: 81691) Sep 26 12:11:31.043755 dv-cinder-827624-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 26 12:11:31.044474 dv-cinder-827624-1-smb devstack@keystone.service[81691]: spawned uWSGI worker 1 (pid: 81702, cores: 1) Sep 26 12:11:31.044658 dv-cinder-827624-1-smb devstack@keystone.service[81691]: spawned uWSGI worker 2 (pid: 81703, cores: 1) Sep 26 12:11:31.044817 dv-cinder-827624-1-smb devstack@keystone.service[81691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 12:11:35.393320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 12:11:35.393320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: from cryptography.utils import int_from_bytes Sep 26 12:11:35.394122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 12:11:35.394122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: from cryptography.utils import int_from_bytes Sep 26 12:11:35.394618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 12:11:35.394618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Sep 26 12:11:35.395060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 12:11:35.395060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Sep 26 12:11:35.444091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 12:11:35.444269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 12:11:35.444463 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] command line args: [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 12:11:35.444810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 12:11:35.444913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ================================================================================ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 12:11:35.444999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 12:11:35.445141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 12:11:35.445228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] admin_token = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.445336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] command line args: [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 12:11:35.445422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config_dir = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.445558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.445645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 12:11:35.445724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config_source = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.445794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ================================================================================ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 12:11:35.445905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] debug = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config_dir = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config_source = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] debug = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.446954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_config_append = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.447816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_dir = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_config_append = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_dir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.448965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.449997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.450962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.451977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] publish_errors = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] publish_errors = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.452997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.453077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.453229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.453326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] standard_threads = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.453995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_journal = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] standard_threads = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_json = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.454997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_stderr = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.455072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.455151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_syslog = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.455253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.455366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.455468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.455691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.455825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_journal = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.455825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_json = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.456085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.456214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_stderr = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.456348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.456484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_syslog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.456611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.456737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 12:11:35.456860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.456989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.457121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.457257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.457389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.457521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.457652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.457796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.457927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.458965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.459952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.460987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.461922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.462956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.463933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464780 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.464902 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.465910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.466870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.467979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.468912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.469947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.470865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.471861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.472952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.473985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.474980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.475902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.476859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477491 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.477965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478185 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.478961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.479925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.480082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.480228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.480316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.480392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.480557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.480893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.480893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.external = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.password = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.external = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.481948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.token = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.password = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.482980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.token = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.483947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.484113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.484194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.484357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.484438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.485127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.485256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.485669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.485754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.485829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.485911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.485996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.486982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.487148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.487236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.487425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.487524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.487668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.487750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.487922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.488923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.489964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.490149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.490281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.490374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.490537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.490667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.490796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.490926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.491054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.491054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.491310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.491473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.491599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.491740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.491869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.492932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.493975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.494936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.495017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.495193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.495274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.495458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.495542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.495700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.495781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.498672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.498786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.498868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.498981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.499954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.500025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.500105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.500180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.500855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.500937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501755 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.501971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.502940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503824 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.503968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.504998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.505944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.506916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.507984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.508927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509339 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.509874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.510979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.511066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.511226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.511314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.511482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.511568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.511711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.511797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.512199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.512289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.512440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.512526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.512678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.512767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.512920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.513969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.514915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.515067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.515148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.515296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.515397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.515567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.516980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.517982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.518091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.518228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.518336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.518476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.518566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.518724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.518958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.519949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.520093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.523858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.523943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.524984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.525995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526569 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.526934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527790 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.527942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528902 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.528976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.529940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.530889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.531022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.531186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.531269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.531364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.531580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.531664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.531779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 12:11:35.531859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.532065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.532314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.532564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.532800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.533045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.533284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 12:11:35.533459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 12:11:35.562217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.562412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.562492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.562555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.562630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.562808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.571247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.571380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.600518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.600690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.600772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.600862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.656138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.656337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.705820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.706008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.706116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.706219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.864223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.864502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.864672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.864832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.864977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.865111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.865243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.865372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.865510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.865648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.865799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.865963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.889683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.889942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.890132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.890362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.890587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.890828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.891763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.893825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.894064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.894290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.894511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.894729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.894944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.895405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.903514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.904227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.927918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.928087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.928175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.928296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.928389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.928529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.928712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.928880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.929029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.929177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.929320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.929464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.929621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.929765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 12:11:35.947087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.947281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 12:11:35.947406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.947663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 12:11:35.947783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.947872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 12:11:35.948052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.948142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.948258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 12:11:35.948389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.948536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.948656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.948801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.948923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.949122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.949393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.959510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.959808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.960115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.960308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.960590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.960729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.960851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.961138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.967508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:35.968487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:35.970518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:35.970806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.971099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.971411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.971752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.972025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.972122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:35.972299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.972382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.972582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.972678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.972865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.972960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.973142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.973235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.973412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.973496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.973714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.974006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.974285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.974562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.974846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.996521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.998033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:35.998336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:35.998568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.000132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.000971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.004097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.004398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.004692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.006267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.006565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.006851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.011200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.011520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.013678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.014006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.018331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.018642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.018938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.019232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.019545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.019832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.020110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.020388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.021046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.021362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.021664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.021964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.022258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.022549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.022829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.023133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.036394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.036690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.039645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.039930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.040605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.043839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.044130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.044264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.047109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.052251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.052433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.052433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.052565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.054935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.055108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.055242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.055558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.055847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.056129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.056410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.058466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.058766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.059051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.059336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.059647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.059937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.073195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.073491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.073767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.074036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.076891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.077197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.077468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.077735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.082429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.083838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.085405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.086161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.086327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.087528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.088496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.088785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.089069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.089225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.089387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.089534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.089751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.092056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.092363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.092690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.093009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.093450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.101509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.101807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.102097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.102404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.102825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.103066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.103402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.105173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.109449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.109449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.109449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.109449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.109449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.109449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.119145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.122131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.122936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.125066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.126792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.127486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.128967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.129250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.129664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.129803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.131191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.132712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.132999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.133398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.138082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.138082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.144327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.144458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.144458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.144458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.144458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.144742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.145417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.145816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.146105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.146388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.150316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.150612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.150899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.154241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.154557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.154849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.157998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.158286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.158574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.158904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.159136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.159439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.159717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.160007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.160287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.160631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.160853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.161138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.161440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.161749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.162302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 12:11:36.162594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.162882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.163165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.163477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.163776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.164057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.164337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.164612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.164890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.165164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.165438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.165715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.166030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 12:11:36.197133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564394c2b9c0 pid: 81702 (default app) Sep 26 12:11:36.200473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293746c-b50b-4c18-9b13-ed5e0411049f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:36.200770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293746c-b50b-4c18-9b13-ed5e0411049f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:36.201046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293746c-b50b-4c18-9b13-ed5e0411049f None None] PATH_INFO: `/v3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:36.201945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564394c2b9c0 pid: 81703 (default app) Sep 26 12:11:36.205817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Mon Sep 26 12:11:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:44.215206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273730c-2492-444f-800e-eefe65455e60 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:44.215820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273730c-2492-444f-800e-eefe65455e60 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:44.215820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273730c-2492-444f-800e-eefe65455e60 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:44.221476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:11:44.227155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:44.227631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:44.227767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:44.301499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: INFO dbcounter [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] Registered counter for database keystone Sep 26 12:11:44.324139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG oslo_db.sqlalchemy.engines [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 12:11:44.331410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writer thread running {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 12:11:44.524105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 12:11:44.524497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 12:11:44.584742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:44.586273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:44.742143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 12:11:45.038888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273730c-2492-444f-800e-eefe65455e60 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:45.111849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: INFO dbcounter [None req-f273730c-2492-444f-800e-eefe65455e60 None None] Registered counter for database keystone Sep 26 12:11:45.132398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG oslo_db.sqlalchemy.engines [None req-f273730c-2492-444f-800e-eefe65455e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 12:11:45.139409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writer thread running {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 12:11:45.275246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273730c-2492-444f-800e-eefe65455e60 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:45.280015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178eeea-9b78-44a9-9a1e-415b9289d58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:45.280671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eeea-9b78-44a9-9a1e-415b9289d58b admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:45.280951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eeea-9b78-44a9-9a1e-415b9289d58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:45.281275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178eeea-9b78-44a9-9a1e-415b9289d58b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:45.291427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178eeea-9b78-44a9-9a1e-415b9289d58b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:45.345464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2178eeea-9b78-44a9-9a1e-415b9289d58b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 12:11:45.345816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178eeea-9b78-44a9-9a1e-415b9289d58b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:45.356279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Sep 26 12:11:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:11:45.363914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:45.382798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96931583-124f-4421-80e3-b0e9d860f441 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:45.387523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf6803-3b3e-4ed5-b2e6-440fedcf4206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:45.388688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf6803-3b3e-4ed5-b2e6-440fedcf4206 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:45.388962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf6803-3b3e-4ed5-b2e6-440fedcf4206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:45.389226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf6803-3b3e-4ed5-b2e6-440fedcf4206 admin admin] PATH_INFO: `/v3/projects/72cdb02c523548e3a44964d7bf629c5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:45.390920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf6803-3b3e-4ed5-b2e6-440fedcf4206 admin admin] RBAC: Authorizing `identity:get_project(project_id=72cdb02c523548e3a44964d7bf629c5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:45.445903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0fbf6803-3b3e-4ed5-b2e6-440fedcf4206 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 12:11:45.446238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf6803-3b3e-4ed5-b2e6-440fedcf4206 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:45.450893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Mon Sep 26 12:11:45 2022] GET /identity/v3/projects/72cdb02c523548e3a44964d7bf629c5b => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:47.638227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c4d1c-4b6c-45bd-b9a9-efa88828d23e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:47.638801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c4d1c-4b6c-45bd-b9a9-efa88828d23e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:47.639212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c4d1c-4b6c-45bd-b9a9-efa88828d23e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:47.648726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:47.654891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7492-9540-429e-8007-0c6e8ddd600b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:47.655419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7492-9540-429e-8007-0c6e8ddd600b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:47.655516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7492-9540-429e-8007-0c6e8ddd600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:47.680045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-817d7492-9540-429e-8007-0c6e8ddd600b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:47.681637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-817d7492-9540-429e-8007-0c6e8ddd600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:47.690275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 26 12:11:47.965496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c4d1c-4b6c-45bd-b9a9-efa88828d23e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:47.977582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c4d1c-4b6c-45bd-b9a9-efa88828d23e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:47.981779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f797f4-c9c5-45d2-9de4-9f9f9cbfd380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:47.982374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f797f4-c9c5-45d2-9de4-9f9f9cbfd380 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:47.982650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f797f4-c9c5-45d2-9de4-9f9f9cbfd380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:47.982919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f797f4-c9c5-45d2-9de4-9f9f9cbfd380 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:47.990585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f797f4-c9c5-45d2-9de4-9f9f9cbfd380 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:47.992371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f797f4-c9c5-45d2-9de4-9f9f9cbfd380 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:48.001845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Sep 26 12:11:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:11:48.007521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7492-9540-429e-8007-0c6e8ddd600b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:48.017618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7492-9540-429e-8007-0c6e8ddd600b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:48.021985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887e95b-8d89-4cb6-a757-355ed85c86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:48.022608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e95b-8d89-4cb6-a757-355ed85c86e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:48.022892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e95b-8d89-4cb6-a757-355ed85c86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:48.023169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887e95b-8d89-4cb6-a757-355ed85c86e3 admin admin] PATH_INFO: `/v3/users/fe7f20c75e5e43198e8f652b576f11c4` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:48.024524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887e95b-8d89-4cb6-a757-355ed85c86e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe7f20c75e5e43198e8f652b576f11c4)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:48.026346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887e95b-8d89-4cb6-a757-355ed85c86e3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:48.027916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Mon Sep 26 12:11:48 2022] GET /identity/v3/users/fe7f20c75e5e43198e8f652b576f11c4 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:50.304827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870212-672e-40d9-bd06-172b8f2c9520 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:50.305387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870212-672e-40d9-bd06-172b8f2c9520 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:50.305387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b870212-672e-40d9-bd06-172b8f2c9520 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:50.306733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:50.313489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b32ca-b879-460d-b898-8a987a61270a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:50.314123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b32ca-b879-460d-b898-8a987a61270a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:50.314310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b32ca-b879-460d-b898-8a987a61270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:50.334229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-984b32ca-b879-460d-b898-8a987a61270a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:50.335419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-984b32ca-b879-460d-b898-8a987a61270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:50.365101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439801-5088-4ebe-997e-ffb7dc945ae3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:50.365380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439801-5088-4ebe-997e-ffb7dc945ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:50.365659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8439801-5088-4ebe-997e-ffb7dc945ae3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:50.367002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:11:50.374019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:50.374442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:50.375373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:50.429520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:50.431849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG passlib.handlers.bcrypt [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81703) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 12:11:50.432293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG passlib.handlers.bcrypt [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81703) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 12:11:50.482767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:50.485044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:50.650570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:11:50.714528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b32ca-b879-460d-b898-8a987a61270a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:50.744619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:50.842574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b32ca-b879-460d-b898-8a987a61270a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:50.880531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:50.881192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:50.881476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:50.881753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:50.895102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:11:50.904208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:11:50.905194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:11:50.906475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:11:50.912560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:50.926971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:51.019096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:51.020321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b269-614c-4ca8-863c-7384696917b2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:51.022762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:51.039736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bcf25-2e5f-4802-83c1-9441cb129de8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:51.061711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:51.063278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:51.063842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:51.066784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:51.068098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:11:51.068412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:51.069889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:51.078274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:51.079227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:51.079538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:51.079816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:51.083163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:51.089413 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:51.163940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:51.165360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:51.196265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5e9b2-ac96-41f4-b0db-1316bd41cbe7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:51.235962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:51.236855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:51.237132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:51.237401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] PATH_INFO: `/v3/users/fe7f20c75e5e43198e8f652b576f11c4` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:51.239221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] RBAC: Authorizing `identity:get_user(user_id=fe7f20c75e5e43198e8f652b576f11c4)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:51.240710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:51.242370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 9/16] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:11:51 2022] GET /identity/v3/users/fe7f20c75e5e43198e8f652b576f11c4 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:11:51.247821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:51.269749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:51.289900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:51.290094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 8/17] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 12:11:51.295593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:51.364659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564a201-ecc5-4f5d-ba31-e8751e80f601 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:51.403071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4255597-1007-4d25-960e-699e18c05604 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:51.404005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:51.404673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:51.404937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:51.405216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:51.407240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:51.408772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:51.410394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:11:51.416859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:51.440298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:51.440945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:51.441226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:51.441497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:51.454160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:51.455723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:11:51.472718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:11:51.473646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:11:51.474510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:11:51.474510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:11:51.474510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:11:51.474510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:11:51.479715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:51.516700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:51.537220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe402-6e94-4aa3-9ddf-d736f643be51 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:51.538838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:51.572220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42018bf3-c476-4515-a964-39a3a16e3e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:51.572823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42018bf3-c476-4515-a964-39a3a16e3e01 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:51.573099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42018bf3-c476-4515-a964-39a3a16e3e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:51.573401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42018bf3-c476-4515-a964-39a3a16e3e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:51.574097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42018bf3-c476-4515-a964-39a3a16e3e01 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.domain.id=default, user.id=fe7f20c75e5e43198e8f652b576f11c4) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:11:51.574409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42018bf3-c476-4515-a964-39a3a16e3e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:51.575928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42018bf3-c476-4515-a964-39a3a16e3e01 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:51.582616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e492dc-946f-4095-b2e1-3f877498feb7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:51.584833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Sep 26 12:11:51 2022] GET /identity/v3/role_assignments?user.id=fe7f20c75e5e43198e8f652b576f11c4&scope.domain.id=default&role.id=6e8e99de087147e09c760c84a9b30604 => generated 233 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:51.622016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6a833-bcaf-462b-97ba-620c379c416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:51.622650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a833-bcaf-462b-97ba-620c379c416a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:51.622931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a833-bcaf-462b-97ba-620c379c416a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:51.623206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a833-bcaf-462b-97ba-620c379c416a None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:51.623912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a833-bcaf-462b-97ba-620c379c416a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:11:51.624219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a833-bcaf-462b-97ba-620c379c416a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:51.626185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6a833-bcaf-462b-97ba-620c379c416a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:51.646877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:11:54.361735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331549-6c9b-418b-b0b0-69425cbd6b5e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:54.362274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331549-6c9b-418b-b0b0-69425cbd6b5e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:54.362545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9331549-6c9b-418b-b0b0-69425cbd6b5e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:54.364059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:54.370086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286ac7-8292-40c2-928f-b715a821e657 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:54.371044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286ac7-8292-40c2-928f-b715a821e657 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:54.371537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286ac7-8292-40c2-928f-b715a821e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:54.397379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9d286ac7-8292-40c2-928f-b715a821e657 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:54.398977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9d286ac7-8292-40c2-928f-b715a821e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:54.477692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13165c6-9428-4047-866f-86299154c372 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:54.478315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13165c6-9428-4047-866f-86299154c372 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:54.478782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13165c6-9428-4047-866f-86299154c372 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:54.480712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 13/23] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:54.492014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd445e93-fbdf-416a-a7d2-b1b638d4378c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:54.492755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd445e93-fbdf-416a-a7d2-b1b638d4378c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:54.493539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd445e93-fbdf-416a-a7d2-b1b638d4378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:54.526161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 11/24] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:54.527911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385ffcc-e126-4660-aee4-b849cd4abbef None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:54.528409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385ffcc-e126-4660-aee4-b849cd4abbef None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:54.528872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385ffcc-e126-4660-aee4-b849cd4abbef None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:54.529971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fd445e93-fbdf-416a-a7d2-b1b638d4378c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:54.531507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 12/25] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:54.533113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fd445e93-fbdf-416a-a7d2-b1b638d4378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:54.540722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e426a55-a77f-40a8-914c-6df5f328eba1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:54.541264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e426a55-a77f-40a8-914c-6df5f328eba1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:54.541754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e426a55-a77f-40a8-914c-6df5f328eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:54.582177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3e426a55-a77f-40a8-914c-6df5f328eba1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:54.588864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3e426a55-a77f-40a8-914c-6df5f328eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:54.642710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:54.713970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 14/26] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:54.745730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 13/27] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:54.824982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd445e93-fbdf-416a-a7d2-b1b638d4378c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:54.960616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:54.966787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd445e93-fbdf-416a-a7d2-b1b638d4378c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:55.012641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:55.013260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.013534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.013802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.014475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:55.016397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:55.097877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e426a55-a77f-40a8-914c-6df5f328eba1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:55.299037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e426a55-a77f-40a8-914c-6df5f328eba1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:55.344679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 15/28] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Sep 26 12:11:54 2022] POST /identity/v3/roles => generated 219 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:11:55.345335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:55.346001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.346282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.346555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.353928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:55.370967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:11:55.383842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:11:55.384839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:11:55.385591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:11:55.388852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 14/29] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:11:55.404045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:55.447936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:55.580326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96a542-a51b-4cd3-af84-caea5130a490 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:55.640359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a996e1-24f2-4ed5-9189-010c6a91576f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:55.643786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d7124-e043-4090-8084-0f2da12bc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:55.644458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d7124-e043-4090-8084-0f2da12bc305 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.644744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d7124-e043-4090-8084-0f2da12bc305 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.645021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d7124-e043-4090-8084-0f2da12bc305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.674833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d7124-e043-4090-8084-0f2da12bc305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:55.676769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d7124-e043-4090-8084-0f2da12bc305 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:55.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7049a8-9f1e-4ba9-8ee8-683bb25237e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:55.689719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7049a8-9f1e-4ba9-8ee8-683bb25237e6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.690216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7049a8-9f1e-4ba9-8ee8-683bb25237e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.690684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7049a8-9f1e-4ba9-8ee8-683bb25237e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.691625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7049a8-9f1e-4ba9-8ee8-683bb25237e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:11:55.692127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7049a8-9f1e-4ba9-8ee8-683bb25237e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:55.693731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7049a8-9f1e-4ba9-8ee8-683bb25237e6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f95d7124-e043-4090-8084-0f2da12bc305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:11:55.700018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:11:55.700920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:11:55.701707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:11:55.701707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:11:55.701707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:11:55.701707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 16/30] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:11:55.703842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097e2e-d4fd-4381-b9b4-d5174ce365f3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.704176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097e2e-d4fd-4381-b9b4-d5174ce365f3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.704400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097e2e-d4fd-4381-b9b4-d5174ce365f3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.706077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 17/31] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:55.708286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaee30-e5a8-49f2-8a5f-3e3cb6dfdcf0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.708286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaee30-e5a8-49f2-8a5f-3e3cb6dfdcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.709539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaee30-e5a8-49f2-8a5f-3e3cb6dfdcf0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.712099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 18/32] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:55.712099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaee30-e5a8-49f2-8a5f-3e3cb6dfdcf0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:55.721151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 15/33] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:55.727395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7c6e-11f7-426c-a85b-b7991a9bee77 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.727395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7c6e-11f7-426c-a85b-b7991a9bee77 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.727395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a7c6e-11f7-426c-a85b-b7991a9bee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.729544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:55.747114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-db2a7c6e-11f7-426c-a85b-b7991a9bee77 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:55.748474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-db2a7c6e-11f7-426c-a85b-b7991a9bee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:55.839800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 16/34] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:55.841175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930497fa-f269-459f-97f4-7765a082a5f3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.841561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930497fa-f269-459f-97f4-7765a082a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.841906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930497fa-f269-459f-97f4-7765a082a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.858364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:55.865943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-930497fa-f269-459f-97f4-7765a082a5f3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:55.886420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-930497fa-f269-459f-97f4-7765a082a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:55.886567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaee30-e5a8-49f2-8a5f-3e3cb6dfdcf0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:55.910372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:55.911551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:55.912475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:55.912977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:55.914103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:11:55.914602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:55.916248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:55.938272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 19/35] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:55.939678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:56.008581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 17/36] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:56.017555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930497fa-f269-459f-97f4-7765a082a5f3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:56.044162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:56.110722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d82f13-74fb-43d5-b322-df00a458ea5b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:56.160596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f313a7f-a3c9-44c3-9ac5-126d44772228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:56.161798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f313a7f-a3c9-44c3-9ac5-126d44772228 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:56.162446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f313a7f-a3c9-44c3-9ac5-126d44772228 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:56.162800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f313a7f-a3c9-44c3-9ac5-126d44772228 None admin] PATH_INFO: `/v3/users/fe7f20c75e5e43198e8f652b576f11c4` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:56.164515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f313a7f-a3c9-44c3-9ac5-126d44772228 None admin] RBAC: Authorizing `identity:get_user(user_id=fe7f20c75e5e43198e8f652b576f11c4)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:56.166928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f313a7f-a3c9-44c3-9ac5-126d44772228 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:56.169385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 20/37] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:11:55 2022] GET /identity/v3/users/fe7f20c75e5e43198e8f652b576f11c4 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:56.170786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841ae4b-e69c-4d25-ac15-0a224bf99ee3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:56.171169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841ae4b-e69c-4d25-ac15-0a224bf99ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:56.171602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841ae4b-e69c-4d25-ac15-0a224bf99ee3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:56.174062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 21/38] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:56.174910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841ae4b-e69c-4d25-ac15-0a224bf99ee3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:56.188974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930497fa-f269-459f-97f4-7765a082a5f3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:56.229096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:56.229849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:56.230129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:56.230412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:56.231052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:56.232554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:56.239695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:56.293574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841ae4b-e69c-4d25-ac15-0a224bf99ee3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:56.331121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b320a-0901-498d-883f-0015b0ccee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:56.331767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b320a-0901-498d-883f-0015b0ccee49 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:56.332054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b320a-0901-498d-883f-0015b0ccee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:56.332323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b320a-0901-498d-883f-0015b0ccee49 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:56.333008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b320a-0901-498d-883f-0015b0ccee49 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:56.334430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b320a-0901-498d-883f-0015b0ccee49 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:56.339142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:56.461285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 22/39] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Sep 26 12:11:56 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:11:56.463053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340555-d090-4e42-9b3c-6d32b6e7e730 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:56.463360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340555-d090-4e42-9b3c-6d32b6e7e730 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:56.463648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340555-d090-4e42-9b3c-6d32b6e7e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:56.489924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fb340555-d090-4e42-9b3c-6d32b6e7e730 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:56.491853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fb340555-d090-4e42-9b3c-6d32b6e7e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:56.590872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 18/40] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:11:56 2022] POST /identity/v3/projects => generated 301 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:11:56.605136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 23/41] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:56.605756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:56.605844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340555-d090-4e42-9b3c-6d32b6e7e730 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:56.788833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340555-d090-4e42-9b3c-6d32b6e7e730 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:56.791695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca983eda-4468-478d-ae74-b55097d94712 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:56.828211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:56.841086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:56.842023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:56.842127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:56.842943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:56.843040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:56.843227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:56.843570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:56.844018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:56.844559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:56.846194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:56.846343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:56.848563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:56.850800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 19/42] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:11:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:56.857712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:56.929936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:56.952250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 24/43] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Sep 26 12:11:56 2022] POST /identity/v3/roles => generated 223 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:11:56.954018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:57.005893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d615-51f6-4097-aea6-0c902a05a9ec None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:57.053686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:57.054285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:57.054571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:57.054860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] PATH_INFO: `/v3/domains/default/users/fe7f20c75e5e43198e8f652b576f11c4/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:57.057229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fe7f20c75e5e43198e8f652b576f11c4, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:57.058795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:57.106101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afed0f6-a840-440c-9e52-32ce25aff043 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:57.159916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 20/44] 10.222.0.49 () {58 vars in 1361 bytes} [Mon Sep 26 12:11:56 2022] PUT /identity/v3/domains/default/users/fe7f20c75e5e43198e8f652b576f11c4/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:11:57.165543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb248f-1eef-4e21-afbc-39bc06d8d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:57.165897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb248f-1eef-4e21-afbc-39bc06d8d6ee None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:57.166369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb248f-1eef-4e21-afbc-39bc06d8d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:57.166646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb248f-1eef-4e21-afbc-39bc06d8d6ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:57.168831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb248f-1eef-4e21-afbc-39bc06d8d6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:57.170367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb248f-1eef-4e21-afbc-39bc06d8d6ee None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:57.172367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 25/45] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:11:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:11:57.181514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:57.355532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf843d-7e4d-4080-b48b-e3c8d434d11b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:57.380399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:57.401172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d8a88-47e2-4780-9158-780a2debebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:57.401872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d8a88-47e2-4780-9158-780a2debebd4 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:57.405737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d8a88-47e2-4780-9158-780a2debebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:57.405737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d8a88-47e2-4780-9158-780a2debebd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:57.405737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d8a88-47e2-4780-9158-780a2debebd4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:11:57.405737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d8a88-47e2-4780-9158-780a2debebd4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:11:57.528801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 21/46] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:11:57 2022] POST /identity/v3/projects => generated 312 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:11:59.428755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20414-cfe3-4d12-b32d-759ed3ecf86a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:59.429278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20414-cfe3-4d12-b32d-759ed3ecf86a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:59.429360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20414-cfe3-4d12-b32d-759ed3ecf86a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:59.430673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 26/47] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:59.436382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82748f2b-9fd3-41ca-b101-fa658ba1973b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:59.437406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82748f2b-9fd3-41ca-b101-fa658ba1973b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:59.437605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82748f2b-9fd3-41ca-b101-fa658ba1973b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:59.457987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-82748f2b-9fd3-41ca-b101-fa658ba1973b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:59.459588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-82748f2b-9fd3-41ca-b101-fa658ba1973b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:59.529425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 22/48] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:11:59.795434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20414-cfe3-4d12-b32d-759ed3ecf86a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:11:59.822803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a947-2ace-485e-8c04-0f316013dbfc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:59.823088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a947-2ace-485e-8c04-0f316013dbfc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:59.823407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85a947-2ace-485e-8c04-0f316013dbfc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:59.824784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 23/49] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:11:59.832759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f965-09ed-4463-8e03-3b4855a19829 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:59.833136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f965-09ed-4463-8e03-3b4855a19829 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:59.833482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99f965-09ed-4463-8e03-3b4855a19829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:59.851872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2f99f965-09ed-4463-8e03-3b4855a19829 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:11:59.853109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f99f965-09ed-4463-8e03-3b4855a19829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:11:59.860158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:11:59.908374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20414-cfe3-4d12-b32d-759ed3ecf86a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:11:59.927026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 24/50] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:11:59.944806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:11:59.945434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:11:59.945713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:11:59.945983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:11:59.958142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:11:59.964173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:11:59.965010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:11:59.965758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 27/51] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:11:59.971843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99f965-09ed-4463-8e03-3b4855a19829 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:00.001292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:00.080392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99f965-09ed-4463-8e03-3b4855a19829 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:00.120423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:00.121037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:00.121316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:00.121582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:00.122250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:00.122550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:00.123973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:00.134080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 25/52] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:00.140852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:00.200925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:00.243719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f4bd8-4489-4660-a75d-fe0c0363ad45 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:00.257585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:00.284982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:00.286173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:00.286592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:00.286986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] PATH_INFO: `/v3/users/fe7f20c75e5e43198e8f652b576f11c4` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:00.288814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=fe7f20c75e5e43198e8f652b576f11c4)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:00.290611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:00.292634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 28/53] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:00 2022] GET /identity/v3/users/fe7f20c75e5e43198e8f652b576f11c4 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:00.298198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:00.305228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:00.316244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed686ec-7ec4-471a-9410-75dcb67e52e6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:00.360951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:00.361612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:00.361897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:00.362177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:00.363385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:00.364850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:00.366531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 26/54] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:00.372255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:00.417871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe9366-559a-438f-9618-d3acff87a4e2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:00.455753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:00.456715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:00.457000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:00.457438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:00.458718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:00.460148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:00.461743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 29/55] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:00.467830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:00.480453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f07a9-d663-48c4-add2-945a010bb1f5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:00.516508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ddf24-898c-4327-82c1-5c1e2714b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:00.517127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ddf24-898c-4327-82c1-5c1e2714b5e5 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:00.517409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ddf24-898c-4327-82c1-5c1e2714b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:00.517684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ddf24-898c-4327-82c1-5c1e2714b5e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:00.518341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ddf24-898c-4327-82c1-5c1e2714b5e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:00.519866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ddf24-898c-4327-82c1-5c1e2714b5e5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:00.524664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:00.576164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89f6b9-4ca3-4e64-a4c4-3ffde93edc77 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:00.611242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdea4d1-425c-49f0-8767-f1e1f82933c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:00.611815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea4d1-425c-49f0-8767-f1e1f82933c0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:00.612101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea4d1-425c-49f0-8767-f1e1f82933c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:00.612378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdea4d1-425c-49f0-8767-f1e1f82933c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:00.613122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea4d1-425c-49f0-8767-f1e1f82933c0 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.domain.id=default, user.id=fe7f20c75e5e43198e8f652b576f11c4) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:00.613439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea4d1-425c-49f0-8767-f1e1f82933c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:00.614905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdea4d1-425c-49f0-8767-f1e1f82933c0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:00.620852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 30/56] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Sep 26 12:12:00 2022] GET /identity/v3/role_assignments?user.id=fe7f20c75e5e43198e8f652b576f11c4&scope.domain.id=default&role.id=6e8e99de087147e09c760c84a9b30604 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:00.631810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 27/57] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Sep 26 12:12:00 2022] POST /identity/v3/projects => generated 298 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:12:02.891708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac26a4-da73-4020-96ea-82c7f337ec02 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:02.892252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac26a4-da73-4020-96ea-82c7f337ec02 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:02.892252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac26a4-da73-4020-96ea-82c7f337ec02 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:02.893686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 31/58] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:02.899724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f73165-33ec-478a-ae3d-c808e671d8c9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:02.900215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f73165-33ec-478a-ae3d-c808e671d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:02.900299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f73165-33ec-478a-ae3d-c808e671d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:02.920589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-19f73165-33ec-478a-ae3d-c808e671d8c9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:02.922580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-19f73165-33ec-478a-ae3d-c808e671d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:02.925961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:03.004488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 28/59] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:03.290347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac26a4-da73-4020-96ea-82c7f337ec02 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:03.412097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac26a4-da73-4020-96ea-82c7f337ec02 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:03.435637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:03.460727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68d279-0a9f-4149-8d5d-4b0f3e76dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:03.461452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d279-0a9f-4149-8d5d-4b0f3e76dd8e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:03.461793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d279-0a9f-4149-8d5d-4b0f3e76dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:03.462067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d279-0a9f-4149-8d5d-4b0f3e76dd8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:03.463380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68d279-0a9f-4149-8d5d-4b0f3e76dd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:03.464882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68d279-0a9f-4149-8d5d-4b0f3e76dd8e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:03.466561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 32/60] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:03.473326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f73165-33ec-478a-ae3d-c808e671d8c9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:03.637620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f73165-33ec-478a-ae3d-c808e671d8c9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:03.678386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b300020-d8ec-47cf-a119-7dbea2d37939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:03.679020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300020-d8ec-47cf-a119-7dbea2d37939 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:03.679303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300020-d8ec-47cf-a119-7dbea2d37939 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:03.679614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300020-d8ec-47cf-a119-7dbea2d37939 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:03.680298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300020-d8ec-47cf-a119-7dbea2d37939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:03.681779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b300020-d8ec-47cf-a119-7dbea2d37939 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:03.699936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:03.801846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 29/61] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:12:03 2022] POST /identity/v3/users => generated 275 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:07.477043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded7760-d72d-4ba4-a63d-c3427d7cb149 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:07.477574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded7760-d72d-4ba4-a63d-c3427d7cb149 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:07.477574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded7760-d72d-4ba4-a63d-c3427d7cb149 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:07.479015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 33/62] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:07.485419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641d944-6f26-4384-8264-d829bd81eb1f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:07.486416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641d944-6f26-4384-8264-d829bd81eb1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:07.486881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641d944-6f26-4384-8264-d829bd81eb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:07.512692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9641d944-6f26-4384-8264-d829bd81eb1f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:07.513919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9641d944-6f26-4384-8264-d829bd81eb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:07.626738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 30/63] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:07.671921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2758cf-6cef-4c5e-9544-5c2681850b34 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:07.672567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2758cf-6cef-4c5e-9544-5c2681850b34 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:07.673051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2758cf-6cef-4c5e-9544-5c2681850b34 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:07.674646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 34/64] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:07.680512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63625e-82da-4174-9c9e-71bd7a472e61 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:07.680814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63625e-82da-4174-9c9e-71bd7a472e61 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:07.681082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63625e-82da-4174-9c9e-71bd7a472e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:07.707930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-af63625e-82da-4174-9c9e-71bd7a472e61 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:07.709163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af63625e-82da-4174-9c9e-71bd7a472e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:07.824140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 31/65] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:07.871475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4b75-eef0-4ac3-8f40-7b3d38d7bfc0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:07.872129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4b75-eef0-4ac3-8f40-7b3d38d7bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:07.872611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e4b75-eef0-4ac3-8f40-7b3d38d7bfc0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:07.874284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 35/66] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:07.885411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147a63-c1e6-46cc-b70b-38533cb7bc4a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:07.885704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147a63-c1e6-46cc-b70b-38533cb7bc4a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:07.886183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2147a63-c1e6-46cc-b70b-38533cb7bc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:07.916469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a2147a63-c1e6-46cc-b70b-38533cb7bc4a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:07.917962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a2147a63-c1e6-46cc-b70b-38533cb7bc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:07.988237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:08.010668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 32/67] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:08.130549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4b75-eef0-4ac3-8f40-7b3d38d7bfc0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:08.236619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147a63-c1e6-46cc-b70b-38533cb7bc4a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:08.410533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e4b75-eef0-4ac3-8f40-7b3d38d7bfc0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:08.426522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2147a63-c1e6-46cc-b70b-38533cb7bc4a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:08.447685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31476c77-b7db-4b8d-a8d7-0a23bc4e27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:08.448327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31476c77-b7db-4b8d-a8d7-0a23bc4e27f9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.448616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31476c77-b7db-4b8d-a8d7-0a23bc4e27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.448892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31476c77-b7db-4b8d-a8d7-0a23bc4e27f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.460091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31476c77-b7db-4b8d-a8d7-0a23bc4e27f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:08.463481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:08.464130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.464409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.464680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-31476c77-b7db-4b8d-a8d7-0a23bc4e27f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:08.465119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:08.466047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:08.466822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:08.469648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 36/68] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:08.471222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7852d-be56-4b6a-8802-5db92daf4816 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.471542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7852d-be56-4b6a-8802-5db92daf4816 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.471819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7852d-be56-4b6a-8802-5db92daf4816 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.473080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 37/69] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:08.474392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487559-eb12-4ae8-92c7-2bedcca84a32 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.478317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487559-eb12-4ae8-92c7-2bedcca84a32 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.478317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e487559-eb12-4ae8-92c7-2bedcca84a32 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.478317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 38/70] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:08.478317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e487559-eb12-4ae8-92c7-2bedcca84a32 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:08.490546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:08.495961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:08.497282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 33/71] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:12:08.499585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:08.539052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:08.552365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:08.613613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e487559-eb12-4ae8-92c7-2bedcca84a32 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:08.619066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904147d3-8827-4eb5-a529-c9fd7ad8039d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:08.657509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c69eb-6a99-4dac-abe2-644d2bbee75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:08.658161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c69eb-6a99-4dac-abe2-644d2bbee75c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.658361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc494b-889d-4b38-9ec9-99d009a57afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:08.658530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c69eb-6a99-4dac-abe2-644d2bbee75c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.658711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c69eb-6a99-4dac-abe2-644d2bbee75c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.658984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc494b-889d-4b38-9ec9-99d009a57afe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.659269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc494b-889d-4b38-9ec9-99d009a57afe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.659599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc494b-889d-4b38-9ec9-99d009a57afe None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.660279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc494b-889d-4b38-9ec9-99d009a57afe None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:08.660651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc494b-889d-4b38-9ec9-99d009a57afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:08.662017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc494b-889d-4b38-9ec9-99d009a57afe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:08.672006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 34/72] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:08.672271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c69eb-6a99-4dac-abe2-644d2bbee75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:08.673279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4664-e5ca-411b-b9af-dd42cae75123 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.673562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4664-e5ca-411b-b9af-dd42cae75123 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.673841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4664-e5ca-411b-b9af-dd42cae75123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ab7c69eb-6a99-4dac-abe2-644d2bbee75c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:08.681347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:08.683495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:08.684391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 39/73] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:08.685613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579484-498a-4127-886d-6bb2a28799be None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:08.685861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579484-498a-4127-886d-6bb2a28799be None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:08.686149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f579484-498a-4127-886d-6bb2a28799be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:08.698020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f9f4664-e5ca-411b-b9af-dd42cae75123 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:08.699852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f9f4664-e5ca-411b-b9af-dd42cae75123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:08.706418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9f579484-498a-4127-886d-6bb2a28799be None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:08.707682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9f579484-498a-4127-886d-6bb2a28799be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:08.778465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 35/74] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:08.779372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4664-e5ca-411b-b9af-dd42cae75123 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:08.810485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 40/75] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:08.811412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f579484-498a-4127-886d-6bb2a28799be None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:08.867985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:08.873868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.000023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f579484-498a-4127-886d-6bb2a28799be None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.024235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4664-e5ca-411b-b9af-dd42cae75123 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.033091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.034170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.034779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.035314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.066746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.066951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.067926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.068605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.069028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.069798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.070088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:09.070566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.072941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.073242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 41/76] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:08 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.074441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.091049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 36/77] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.091049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.189523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.199190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9216-69ec-4cd1-a1ec-6d585a659b18 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.205981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.205981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00074a74-c845-43ca-96d4-45cb012f6538 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.240076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.240703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.240989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.241264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.242014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:09.242327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.243776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.251536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.252574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.253088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.253215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 42/78] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.253579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.254005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.273629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:09.284218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:09.285865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 37/79] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:09.288175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.373164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f114c837-52b2-4679-8413-592a057cbf58 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.411574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.412275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.412485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.412759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.425668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a941d-efae-4ec6-802f-0701fa832b9a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.436259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.475333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.476001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.476282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.476552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] PATH_INFO: `/v3/users/fe7f20c75e5e43198e8f652b576f11c4` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.477682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] RBAC: Authorizing `identity:get_user(user_id=fe7f20c75e5e43198e8f652b576f11c4)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.479146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.486015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 38/80] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/users/fe7f20c75e5e43198e8f652b576f11c4 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.486015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.493325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.494810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.513142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.603073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bae7f4-7398-40b1-a672-28275943f664 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.630289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 43/81] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:09.631155 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.643449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.644106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.644447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.644759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.646146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.647380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.648973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 39/82] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.649746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.695070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.750842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac364275-c89f-4fe7-9fd8-d63e3cfc6927 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.757175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.763789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b2fd0-b035-4299-a29b-fefc0928d68e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.785717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.786355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.786638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.787003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.788236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.789692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.791272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 44/83] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.792069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.800082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.800691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.800969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.801244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.801910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:09.802213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.803627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.812439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 40/84] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.813291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.918705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5b4c-fec8-4a53-bcf5-ce415ebd0275 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.919137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37adac2-1322-4480-9e35-97b6bcbd1605 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:09.941911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:09.953949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.964325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.964325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.964325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.964325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:09.964325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:09.964852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:09.964852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:09.965005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 41/85] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:09.965070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:09.965070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:09.965195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:09.990118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:10.037001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:10.038392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:10.070187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ee5fe-702a-4882-b18b-eb765d882c2a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:10.108793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:10.109492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:10.109781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:10.110057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:10.110723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:10.112239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:10.144598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 45/86] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:10.145473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:10.175930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:10.218831 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 42/87] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:12:09 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:10.220163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:10.266635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1458e-b54e-48c1-9865-ff591ad09d8b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:10.308676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:10.309222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:10.309505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:10.309814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:10.322984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:10.344839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c1d99-339e-4f1f-be62-ec74430cabd8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:10.390279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:10.390985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:10.391228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:10.391546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:10.392757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:10.394302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:10.395958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 43/88] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:10 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:10.396079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:10.396738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:10.402092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:10.429521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:10.529543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 46/89] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:10.530800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:10.579560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446c001-fa88-4441-b76c-8076c8ef8685 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:10.642798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:10.644001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:10.644285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:10.644560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:10.645608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=d31177bfd20d4a24b2ad2d6532971805) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:10.645922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:10.648227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:10.653958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b622d01-72ad-4409-adea-fd0cb9e88b4b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:10.658511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 44/90] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:10 2022] GET /identity/v3/role_assignments?user.id=d31177bfd20d4a24b2ad2d6532971805&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:10.659406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:10.682084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:10.696225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:10.736800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:10.737573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:10.737857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:10.738131 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:10.740378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:10.741862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:10.748350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 47/91] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:10 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:10.749610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:10.867614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54cf6b8-d672-4175-8306-0d4af04b08e5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:10.888702 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73df583-e8c8-426a-bea7-1eec060815b5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:10.930189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:10.931136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:10.931625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:10.932263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:10.934447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:10.937799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:10.941429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 48/92] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:10 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:10.942717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:10.944281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:10.944923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:10.945205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:10.945477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:11.053085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:11.073831 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:11.076322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:11.115336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:11.146717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a161-9701-4c28-b17b-5d97d66bbb7c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:11.188768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:11.189392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:11.189703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:11.190231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:11.191093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=fe7f20c75e5e43198e8f652b576f11c4) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:11.191437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:11.193362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:11.200031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 49/93] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:10 2022] GET /identity/v3/role_assignments?user.id=fe7f20c75e5e43198e8f652b576f11c4&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:11.200961 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:11.314386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee1d73-18ff-465d-a122-33cd75a5257c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:11.357983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 45/94] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:11.359573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:11.360268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:11.360554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:11.360829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:11.361589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] RBAC: Adding query filter params (role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=d31177bfd20d4a24b2ad2d6532971805) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:11.361901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:11.363429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:11.368442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:11.369784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 50/95] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:11 2022] GET /identity/v3/role_assignments?user.id=d31177bfd20d4a24b2ad2d6532971805&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:11.370177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:11.560785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b0325-abb9-468f-92f7-b1521c1b55e5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:11.577977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:11.607130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258eb959-44e9-4250-8e6d-f838e246792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:11.608098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb959-44e9-4250-8e6d-f838e246792a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:11.608936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb959-44e9-4250-8e6d-f838e246792a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:11.609368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258eb959-44e9-4250-8e6d-f838e246792a None admin] PATH_INFO: `/v3/projects/2789458ff43b4091a5490fc47df09435` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:11.612103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258eb959-44e9-4250-8e6d-f838e246792a None admin] RBAC: Authorizing `identity:get_project(project_id=2789458ff43b4091a5490fc47df09435)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:11.613681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258eb959-44e9-4250-8e6d-f838e246792a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:11.615649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 46/96] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:11 2022] GET /identity/v3/projects/2789458ff43b4091a5490fc47df09435 => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:11.621441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:11.781474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e76ae-7e4f-477b-af95-045a0db618fe None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:11.849351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927d0b3-2e2f-4280-937c-90e62fa54024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:11.850339 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d0b3-2e2f-4280-937c-90e62fa54024 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:11.850857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d0b3-2e2f-4280-937c-90e62fa54024 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:11.851392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927d0b3-2e2f-4280-937c-90e62fa54024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:11.852823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927d0b3-2e2f-4280-937c-90e62fa54024 None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=2789458ff43b4091a5490fc47df09435, user.id=d31177bfd20d4a24b2ad2d6532971805) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:11.853408 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927d0b3-2e2f-4280-937c-90e62fa54024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:11.856318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927d0b3-2e2f-4280-937c-90e62fa54024 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:11.867369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 51/97] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:11 2022] GET /identity/v3/role_assignments?user.id=d31177bfd20d4a24b2ad2d6532971805&scope.project.id=2789458ff43b4091a5490fc47df09435&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:13.490521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560781-7aee-4fe7-93dc-5a338d9104f4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:13.491595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560781-7aee-4fe7-93dc-5a338d9104f4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:13.492112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560781-7aee-4fe7-93dc-5a338d9104f4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:13.494198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 47/98] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:13.501721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcbe9-8299-4117-a0bf-6ee2b1685a23 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:13.502869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcbe9-8299-4117-a0bf-6ee2b1685a23 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:13.503376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcbe9-8299-4117-a0bf-6ee2b1685a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:13.543597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e4fdcbe9-8299-4117-a0bf-6ee2b1685a23 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:13.545122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e4fdcbe9-8299-4117-a0bf-6ee2b1685a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:13.608622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:13.640786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 52/99] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:13.875138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a0d4-a001-4937-ba66-ef6f581170d6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:13.875560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a0d4-a001-4937-ba66-ef6f581170d6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:13.875775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713a0d4-a001-4937-ba66-ef6f581170d6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:13.877434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 48/100] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:13.882765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fdfe-2b5e-4986-b6ad-425508b34e1f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:13.883061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fdfe-2b5e-4986-b6ad-425508b34e1f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:13.883442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fdfe-2b5e-4986-b6ad-425508b34e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:13.906174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e978fdfe-2b5e-4986-b6ad-425508b34e1f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:13.907690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e978fdfe-2b5e-4986-b6ad-425508b34e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:13.961268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869e06-f171-436e-aa36-6c27065331d2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:13.961569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869e06-f171-436e-aa36-6c27065331d2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:13.961829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c869e06-f171-436e-aa36-6c27065331d2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:13.963311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 49/101] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:13.969297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecad47-2f87-4bc2-84d0-7e3ac2d446ad None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:13.969647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecad47-2f87-4bc2-84d0-7e3ac2d446ad None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:13.969851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecad47-2f87-4bc2-84d0-7e3ac2d446ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:14.002848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a0ecad47-2f87-4bc2-84d0-7e3ac2d446ad None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:14.007114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a0ecad47-2f87-4bc2-84d0-7e3ac2d446ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:14.067433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 53/102] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:14.142547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 50/103] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:14.165834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fdfe-2b5e-4986-b6ad-425508b34e1f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:14.293215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fdfe-2b5e-4986-b6ad-425508b34e1f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:14.304165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:14.339208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:14.339904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:14.340190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:14.340475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:14.357007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:14.362451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:14.363314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:14.364098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 54/104] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:14.371144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecad47-2f87-4bc2-84d0-7e3ac2d446ad None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:14.518966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecad47-2f87-4bc2-84d0-7e3ac2d446ad None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:14.568778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:14.639259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:14.688776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:14.689420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:14.689705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:14.689989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:14.690697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:14.691001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:14.692462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:14.705020 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8436170-69e6-4f7f-a5e9-26b289fddcda None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:14.710689 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 51/105] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:14.711592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:14.750609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:14.751312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:14.751618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:14.751893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:14.754707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:14.756222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:14.760612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 55/106] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:14.762844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:14.834154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:14.921939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ba37d-6dcd-47f3-b764-25e05c63c06e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:14.943400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af030b-8841-40f8-8076-2df35eb367eb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:14.972068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:14.973072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:14.973547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:14.974026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] PATH_INFO: `/v3/users/88c8e377ca354cec96c7940f2a252d3e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.000356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] RBAC: Authorizing `identity:get_user(user_id=88c8e377ca354cec96c7940f2a252d3e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:15.002172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:15.003024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:15.003958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.004430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.004891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.005298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 56/107] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:14 2022] GET /identity/v3/users/88c8e377ca354cec96c7940f2a252d3e => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:15.006243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:15.023006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:15.029604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:15.031890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:15.033299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:15.038004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 52/108] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:15.039986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:15.119731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:15.145999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:15.153417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cbe6b-a262-46b0-a34c-a679186dd9ea None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:15.191081 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3cff2-9bd8-4241-911f-400507503964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:15.191900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3cff2-9bd8-4241-911f-400507503964 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.192214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a040f2-2d16-469e-a411-c7fbf28d2231 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:15.205460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3cff2-9bd8-4241-911f-400507503964 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.205460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3cff2-9bd8-4241-911f-400507503964 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.205460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3cff2-9bd8-4241-911f-400507503964 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:15.205460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3cff2-9bd8-4241-911f-400507503964 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:15.227085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74413b-18b6-4e8d-89c9-9a8dbd3dc9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:15.227736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74413b-18b6-4e8d-89c9-9a8dbd3dc9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.228023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74413b-18b6-4e8d-89c9-9a8dbd3dc9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.228301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74413b-18b6-4e8d-89c9-9a8dbd3dc9b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.298247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74413b-18b6-4e8d-89c9-9a8dbd3dc9b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:15.299754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74413b-18b6-4e8d-89c9-9a8dbd3dc9b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:15.333101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:15.400434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 57/109] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:12:15 2022] POST /identity/v3/projects => generated 302 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:15.400434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfc01-8698-446e-b0a2-9b940f0efbfc None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.400434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfc01-8698-446e-b0a2-9b940f0efbfc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.400434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cfc01-8698-446e-b0a2-9b940f0efbfc None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.400434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 58/110] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:15.400906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cfc01-8698-446e-b0a2-9b940f0efbfc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:15.419868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 53/111] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:15.422209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba47c3-7e57-4d09-a423-19a16f04ee48 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.422496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba47c3-7e57-4d09-a423-19a16f04ee48 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.422769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba47c3-7e57-4d09-a423-19a16f04ee48 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.424560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 54/112] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:15.425873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8510-48d1-4f0b-b76a-4f220d2d4cec None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.426155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8510-48d1-4f0b-b76a-4f220d2d4cec None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.426485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8510-48d1-4f0b-b76a-4f220d2d4cec None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.433955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 55/113] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:15.433955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741ce5-d7d7-4234-97b2-31e017bb3edd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.433955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741ce5-d7d7-4234-97b2-31e017bb3edd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.433955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78741ce5-d7d7-4234-97b2-31e017bb3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.449899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-78741ce5-d7d7-4234-97b2-31e017bb3edd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:15.451459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-78741ce5-d7d7-4234-97b2-31e017bb3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:15.532565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cfc01-8698-446e-b0a2-9b940f0efbfc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:15.536669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 56/114] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:15.537447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741ce5-d7d7-4234-97b2-31e017bb3edd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:15.589377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d6530-f1ff-42bb-8508-f8972dff2563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:15.590064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6530-f1ff-42bb-8508-f8972dff2563 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.591379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6530-f1ff-42bb-8508-f8972dff2563 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.591687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d6530-f1ff-42bb-8508-f8972dff2563 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.592388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d6530-f1ff-42bb-8508-f8972dff2563 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:15.593256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d6530-f1ff-42bb-8508-f8972dff2563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:15.594687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d6530-f1ff-42bb-8508-f8972dff2563 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:15.606897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 59/115] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:15.609375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe040-94e8-452f-8413-42e02d741f14 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.609641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe040-94e8-452f-8413-42e02d741f14 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.612025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe040-94e8-452f-8413-42e02d741f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.630405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:15.630587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b80fe040-94e8-452f-8413-42e02d741f14 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:15.632198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b80fe040-94e8-452f-8413-42e02d741f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:15.634396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:15.687572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78741ce5-d7d7-4234-97b2-31e017bb3edd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:15.724528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 60/116] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:15.726195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546e9fa-a6cc-40ea-a194-b8b99abdf1f3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.728808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546e9fa-a6cc-40ea-a194-b8b99abdf1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.728808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546e9fa-a6cc-40ea-a194-b8b99abdf1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.728969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:15.730046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.730643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.731129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.732648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:15.734910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:15.741891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 57/117] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:15 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:15.741891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:15.758713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6546e9fa-a6cc-40ea-a194-b8b99abdf1f3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:15.761017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6546e9fa-a6cc-40ea-a194-b8b99abdf1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:15.854626 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 61/118] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:15.855632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546e9fa-a6cc-40ea-a194-b8b99abdf1f3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:15.903297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffe2cc-9d5f-44aa-a526-fd7d635c2420 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:15.940441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:15.946402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:15.947055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:15.947361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:15.947690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:15.948943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:15.950408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:15.953020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 58/119] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:15 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:15.954034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.009923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:16.058058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546e9fa-a6cc-40ea-a194-b8b99abdf1f3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.086665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbc605-f1bd-4a4d-8ed3-0aa6833b8ab6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.110686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.111729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.112011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.112345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.113083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] RBAC: Adding query filter params (role.id=c56909e1368744ca8582c45b1328fb2b, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=88c8e377ca354cec96c7940f2a252d3e) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:16.113438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:16.115480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:16.122061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 62/120] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:15 2022] GET /identity/v3/role_assignments?user.id=88c8e377ca354cec96c7940f2a252d3e&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=c56909e1368744ca8582c45b1328fb2b => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:16.123029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.151792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.152455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.152732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.153002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.177429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:16.185194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:16.186124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:16.186953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 59/121] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:16.191641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.287207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c88d1-8d22-4729-aa97-b3d4509c587f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.292016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:16.330404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:16.338856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.339539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.339821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.340100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.341525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:16.343184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:16.345077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 63/122] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:16 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:16.345669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.352099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ddc27-1e44-4a78-963d-f001424e0a8d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.390164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.390898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.391181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.391494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.402523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:16.408795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:16.410849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 60/123] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:16.412621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.478062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8175-29e6-45ad-8590-129d4723254c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.523361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.524223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.524577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.524924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.525671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:16.526050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:16.528164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:16.540233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 64/124] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:16.541158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.549577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f4491-6444-416d-9b9f-622861c78383 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.572092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:16.586583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.587361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.587742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.588092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.601394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:16.607026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:16.608911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:16.610514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 61/125] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:16.616428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.618429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:16.667658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b61de-4f2a-4701-b6bb-2137a2210853 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.715264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.715963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.716241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.717053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/d31177bfd20d4a24b2ad2d6532971805/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.720616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f8a8823cda45c1925f2cae6377e284, user_id=d31177bfd20d4a24b2ad2d6532971805, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:16.722851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:16.733991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9619b4-1596-4290-bff2-b4a9fa012032 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.771222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:16.771931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:16.772165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:16.772422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:16.773073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:16.773371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:16.774752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:16.784394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 62/126] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:16.785025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.804272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 65/127] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:16 2022] PUT /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/d31177bfd20d4a24b2ad2d6532971805/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:16.805836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:16.845358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:16.957898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448713-d0fe-4b61-93b1-a1adfdb2df84 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.970711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbd581-b3f2-478b-a5ad-f27ccdbf68b2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:16.993487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:17.007403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.008168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.008516 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.009047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.010220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:17.010629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.012771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.026323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 66/128] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:17.027672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.032593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.033449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.033966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.034434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] PATH_INFO: `/v3/users/fe7f20c75e5e43198e8f652b576f11c4` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.035928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] RBAC: Authorizing `identity:get_user(user_id=fe7f20c75e5e43198e8f652b576f11c4)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.037684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.040468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 63/129] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:16 2022] GET /identity/v3/users/fe7f20c75e5e43198e8f652b576f11c4 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:17.041458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.178637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80da02-4450-43f7-93ed-f1e3ef016970 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:17.179291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035e537-b41a-4e72-9246-e111edc07d01 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:17.204560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:17.221752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.222633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.223243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.223822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.225404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.227395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.229374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 67/130] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:17 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:17.230443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.260719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.261305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.261600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.262269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.268108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.269663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.271245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 64/131] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:17 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:17.272128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.294953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:17.385235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cc8c9-e309-473d-87c0-896fc90fc594 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:17.423601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.424750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.424750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.424915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.426593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.428125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.430637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 68/132] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:17 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:17.431543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.508775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd28d74-e523-48ae-8b24-f1a3cfa1148b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:17.551571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f35a-03c5-4b08-8cf5-166db5fbbd37 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:17.576599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:17.587569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.588900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.589459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.590009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] PATH_INFO: `/v3/projects/2789458ff43b4091a5490fc47df09435` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.592162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] RBAC: Authorizing `identity:get_project(project_id=2789458ff43b4091a5490fc47df09435)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.599374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.599374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.599374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.599374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.600734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.601403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.602922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 65/133] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:17 2022] GET /identity/v3/projects/2789458ff43b4091a5490fc47df09435 => generated 312 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:17.603911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.604689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.610815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 69/134] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:17 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:17.613964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.706772 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:17.763411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de33b4b-7a3b-4dc7-819c-eb6084c3c12e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:17.805669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.806341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.806623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.806947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] PATH_INFO: `/v3/projects/2789458ff43b4091a5490fc47df09435/users/d31177bfd20d4a24b2ad2d6532971805/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.810489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] RBAC: Authorizing `identity:create_grant(project_id=2789458ff43b4091a5490fc47df09435, user_id=d31177bfd20d4a24b2ad2d6532971805, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.812478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.828025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1157d9-3cb9-42fa-9f72-1b78fd852a24 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:17.868384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e3be8-3f99-43d5-bdfc-bdda5ad58ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:17.869071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3be8-3f99-43d5-bdfc-bdda5ad58ff6 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:17.869352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3be8-3f99-43d5-bdfc-bdda5ad58ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:17.869629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e3be8-3f99-43d5-bdfc-bdda5ad58ff6 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/fe7f20c75e5e43198e8f652b576f11c4/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:17.871736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e3be8-3f99-43d5-bdfc-bdda5ad58ff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f8a8823cda45c1925f2cae6377e284, user_id=fe7f20c75e5e43198e8f652b576f11c4, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:17.873488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e3be8-3f99-43d5-bdfc-bdda5ad58ff6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:17.922314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 70/135] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:17 2022] PUT /identity/v3/projects/2789458ff43b4091a5490fc47df09435/users/d31177bfd20d4a24b2ad2d6532971805/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:12:17.923025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:17.959088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 66/136] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:17 2022] PUT /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/fe7f20c75e5e43198e8f652b576f11c4/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:18.021365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:18.106550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd103-e270-43bc-b120-42f140443602 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:18.160047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8fb98-f578-445b-ae91-9df792e2af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:18.160767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8fb98-f578-445b-ae91-9df792e2af09 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:18.161055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8fb98-f578-445b-ae91-9df792e2af09 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:18.161340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8fb98-f578-445b-ae91-9df792e2af09 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/d31177bfd20d4a24b2ad2d6532971805/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:18.165538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8fb98-f578-445b-ae91-9df792e2af09 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f8a8823cda45c1925f2cae6377e284, user_id=d31177bfd20d4a24b2ad2d6532971805, role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:18.167180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8fb98-f578-445b-ae91-9df792e2af09 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:18.247530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 71/137] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:17 2022] PUT /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/d31177bfd20d4a24b2ad2d6532971805/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:18.288977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a0cb-d4f8-4202-8a7a-e2e5b4aab24c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:18.289357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a0cb-d4f8-4202-8a7a-e2e5b4aab24c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:18.289842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72a0cb-d4f8-4202-8a7a-e2e5b4aab24c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:18.291720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 67/138] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:18.300956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c104-63e6-4714-ab06-2d880cd4a62c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:18.301348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c104-63e6-4714-ab06-2d880cd4a62c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:18.301613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968c104-63e6-4714-ab06-2d880cd4a62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:18.328959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c968c104-63e6-4714-ab06-2d880cd4a62c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:18.330110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c968c104-63e6-4714-ab06-2d880cd4a62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:18.421852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 72/139] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:18.738097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56dea0-2d34-45b2-a822-a053f3af566c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:18.738613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56dea0-2d34-45b2-a822-a053f3af566c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:18.738685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56dea0-2d34-45b2-a822-a053f3af566c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:18.740344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 68/140] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:18.745828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a626e-bbcb-45f2-a424-87845c86d478 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:18.746424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a626e-bbcb-45f2-a424-87845c86d478 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:18.746914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a626e-bbcb-45f2-a424-87845c86d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:18.776401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-889a626e-bbcb-45f2-a424-87845c86d478 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:18.778373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-889a626e-bbcb-45f2-a424-87845c86d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:18.800523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56dea0-2d34-45b2-a822-a053f3af566c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:18.836507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:18.881025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 73/141] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:19.042667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56dea0-2d34-45b2-a822-a053f3af566c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:19.054556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:19.122636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:19.123488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:19.124028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:19.124410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:19.125664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:19.127226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:19.129166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 69/142] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:19.134700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a626e-bbcb-45f2-a424-87845c86d478 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:19.299548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a626e-bbcb-45f2-a424-87845c86d478 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:19.353632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:19.354310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:19.354600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:19.354872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:19.355583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:19.357102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:19.391641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:19.475745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 74/143] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:12:19 2022] POST /identity/v3/users => generated 283 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:19.548126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89994e2-b9d3-4558-9bb9-12288783e3b8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:19.608653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:19.609335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:19.609623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:19.609904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:19.622415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:19.628508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:19.629425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:19.630183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 70/144] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:12:19.637496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:19.673703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:19.771812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca21a5-6af2-4165-9d12-9db0b22e18c2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:19.824150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6de167-043c-47ad-9ba0-943923d3a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:19.824788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de167-043c-47ad-9ba0-943923d3a453 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:19.825139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de167-043c-47ad-9ba0-943923d3a453 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:19.825416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de167-043c-47ad-9ba0-943923d3a453 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:19.826160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6de167-043c-47ad-9ba0-943923d3a453 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:19.826477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6de167-043c-47ad-9ba0-943923d3a453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:19.828780 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6de167-043c-47ad-9ba0-943923d3a453 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:19.838992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 75/145] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:19.845517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:19.895672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:19.993025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d297c2-d8b2-4a77-9f60-8ce4a4459940 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:20.034842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:20.035548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:20.035835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:20.036129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] PATH_INFO: `/v3/users/88c8e377ca354cec96c7940f2a252d3e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:20.040266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] RBAC: Authorizing `identity:get_user(user_id=88c8e377ca354cec96c7940f2a252d3e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:20.041805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:20.043918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 71/146] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:19 2022] GET /identity/v3/users/88c8e377ca354cec96c7940f2a252d3e => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:20.046878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b973-a915-4a0f-94f2-b25831ec598c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:20.047163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b973-a915-4a0f-94f2-b25831ec598c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:20.047471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8b973-a915-4a0f-94f2-b25831ec598c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:20.049210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 76/147] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:20.054745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022e76-5d8a-4986-86e5-032ab30d6495 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:20.055062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022e76-5d8a-4986-86e5-032ab30d6495 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:20.055284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8022e76-5d8a-4986-86e5-032ab30d6495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:20.059036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:20.098273 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a8022e76-5d8a-4986-86e5-032ab30d6495 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:20.099530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a8022e76-5d8a-4986-86e5-032ab30d6495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:20.242801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 77/148] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:20.254710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eede6-0543-4d2f-a5dd-76d97e2a11da None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:20.262639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:20.294035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:20.294674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:20.294949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:20.295218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:20.297076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:20.298527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:20.300433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 72/149] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:20 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:20.305983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8022e76-5d8a-4986-86e5-032ab30d6495 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:20.326567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:20.412721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8022e76-5d8a-4986-86e5-032ab30d6495 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:20.448490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:20.449153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:20.449429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:20.449711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/88c8e377ca354cec96c7940f2a252d3e/roles/c56909e1368744ca8582c45b1328fb2b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:20.451644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f8a8823cda45c1925f2cae6377e284, user_id=88c8e377ca354cec96c7940f2a252d3e, role_id=c56909e1368744ca8582c45b1328fb2b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:20.453249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:20.586971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 78/150] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:20 2022] PUT /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284/users/88c8e377ca354cec96c7940f2a252d3e/roles/c56909e1368744ca8582c45b1328fb2b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:20.688386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:20.821385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779efc-b49e-45a1-a742-d53866ba3294 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:20.862382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:20.863140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:20.863319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:20.863642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:20.878383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:20.883730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:20.884623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:20.885387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 73/151] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:20.892173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:20.978566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:21.012182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebbf36-55bc-4379-a4cf-a4f23aaaf220 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:21.058174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:21.058785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.059062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.059326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.060115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:21.060468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:21.062420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:21.072123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 79/152] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:21.078604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:21.124909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:21.208681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418dcdd-c8d8-4548-8352-43c385455894 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:21.253513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:21.254159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.254434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.254701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.255878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:21.257355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:21.259189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 74/153] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:21 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:21.265552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:21.395013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469035ab-ca0b-4266-a2ce-b0f53b72e4b1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:21.433753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb324e-a7b8-4bd2-97af-a45e627cac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:21.434369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb324e-a7b8-4bd2-97af-a45e627cac25 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.434646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb324e-a7b8-4bd2-97af-a45e627cac25 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.434913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb324e-a7b8-4bd2-97af-a45e627cac25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.445290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:21.509019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb324e-a7b8-4bd2-97af-a45e627cac25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:21.510673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb324e-a7b8-4bd2-97af-a45e627cac25 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:21.616616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 80/154] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:21.622228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:21.633397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a12b5-d81b-4cfc-9819-267c3e1591ab None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.633698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a12b5-d81b-4cfc-9819-267c3e1591ab None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.633944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a12b5-d81b-4cfc-9819-267c3e1591ab None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.635305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 81/155] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:21.648596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97157a0a-a2fc-4e23-b0a4-74268b94f687 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.648874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97157a0a-a2fc-4e23-b0a4-74268b94f687 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.649047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97157a0a-a2fc-4e23-b0a4-74268b94f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.679954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-97157a0a-a2fc-4e23-b0a4-74268b94f687 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:21.681163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-97157a0a-a2fc-4e23-b0a4-74268b94f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:21.748229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:21.800913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 82/156] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:21.802397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628df1c-77ec-429b-a118-f9dc01aba2ab None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.802935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628df1c-77ec-429b-a118-f9dc01aba2ab None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.803409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628df1c-77ec-429b-a118-f9dc01aba2ab None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.805376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 83/157] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:21.811671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dceaab-7499-4a23-824a-80c13eb3453f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.812465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dceaab-7499-4a23-824a-80c13eb3453f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.813633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dceaab-7499-4a23-824a-80c13eb3453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.824930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:21.833954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762ef61-a586-4f83-a56c-f5af5735562e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:21.857433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-75dceaab-7499-4a23-824a-80c13eb3453f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:21.861378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-75dceaab-7499-4a23-824a-80c13eb3453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:21.915242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:21.916544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:21.917011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:21.917457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:21.919967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:21.922757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:21.925725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 75/158] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:21 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:21.932194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:21.963832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 84/159] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:22.088945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70024-d4d8-4eee-bf09-acbea892c584 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:22.134841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:22.135469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:22.135747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:22.136012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:22.137153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=d31177bfd20d4a24b2ad2d6532971805) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:22.137461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:22.138899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:22.148411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 76/160] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:21 2022] GET /identity/v3/role_assignments?user.id=d31177bfd20d4a24b2ad2d6532971805&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:22.456098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dceaab-7499-4a23-824a-80c13eb3453f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:22.517512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:22.583225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:22.588097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:22.593261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dceaab-7499-4a23-824a-80c13eb3453f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:22.638304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:22.640746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:22.641166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:22.641671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:22.656927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:22.662618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:22.663647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:22.664449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:22.668156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 85/161] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:22.676465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:22.721660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cb46c-2bfc-43b0-8beb-be3142d42962 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:22.809869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:22.809869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:22.809869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:22.809869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:22.826327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f74397-cd5f-4029-8364-7633c0c5dac9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:22.840216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:22.845830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:22.846915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:22.852005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 77/162] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:22.852843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:22.884429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:22.885277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:22.885701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:22.886111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:22.887210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:22.887677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:22.889751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:22.903919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 86/163] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:22.910293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:22.941008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:23.034897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:23.045125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f83f7-fe66-4047-9113-7783b07c65bb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:23.050010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cb41d-3ac2-4bb5-acbf-fb80f85eff57 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:23.089557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cf8e5-a61e-4f80-9b75-6533e3d43dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:23.090450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cf8e5-a61e-4f80-9b75-6533e3d43dea None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.090874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cf8e5-a61e-4f80-9b75-6533e3d43dea None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.091291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cf8e5-a61e-4f80-9b75-6533e3d43dea None admin] PATH_INFO: `/v3/users/fe7f20c75e5e43198e8f652b576f11c4` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.093738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cf8e5-a61e-4f80-9b75-6533e3d43dea None admin] RBAC: Authorizing `identity:get_user(user_id=fe7f20c75e5e43198e8f652b576f11c4)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:23.095531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cf8e5-a61e-4f80-9b75-6533e3d43dea None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:23.097736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 87/164] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:22 2022] GET /identity/v3/users/fe7f20c75e5e43198e8f652b576f11c4 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:23.099297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426383a-0a20-4e39-8805-c5e8365fc0e5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.099742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426383a-0a20-4e39-8805-c5e8365fc0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.100182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426383a-0a20-4e39-8805-c5e8365fc0e5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.102068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 88/165] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:23.102945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426383a-0a20-4e39-8805-c5e8365fc0e5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:23.148802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984a529-8c96-4d4a-a3f6-c0f9a97841b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:23.149443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984a529-8c96-4d4a-a3f6-c0f9a97841b0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.149725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984a529-8c96-4d4a-a3f6-c0f9a97841b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.150000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984a529-8c96-4d4a-a3f6-c0f9a97841b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.150687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984a529-8c96-4d4a-a3f6-c0f9a97841b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:23.150989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984a529-8c96-4d4a-a3f6-c0f9a97841b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:23.152447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984a529-8c96-4d4a-a3f6-c0f9a97841b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:23.174073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 78/166] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:23.175490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cc74f-45cf-400f-971f-b9b7c0a13e02 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.176102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cc74f-45cf-400f-971f-b9b7c0a13e02 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.176102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cc74f-45cf-400f-971f-b9b7c0a13e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.212444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-904cc74f-45cf-400f-971f-b9b7c0a13e02 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:23.213683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-904cc74f-45cf-400f-971f-b9b7c0a13e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:23.215317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:23.232186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426383a-0a20-4e39-8805-c5e8365fc0e5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:23.275499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:23.276379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.276952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.277374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.349721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 79/167] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:23.350928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cc74f-45cf-400f-971f-b9b7c0a13e02 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:23.359751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:23.361540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:23.484332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:23.527429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 89/168] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:23.533637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:23.536097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:23.550589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cc74f-45cf-400f-971f-b9b7c0a13e02 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:23.591947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:23.593955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.594722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.595362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.596956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:23.598735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:23.600813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 80/169] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:23 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:23.606834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:23.742591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8521067-7882-4f30-9369-fd9007ea7546 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:23.807139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:23.808567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.809293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.810039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.812681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:23.819928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:23.823913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 90/170] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:23 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:23.853786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:23.860973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1718b3-eae9-4399-9cd7-3e850d36bc7a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:23.929196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5284ea-897e-4030-8fd8-d1763302967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:23.929832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5284ea-897e-4030-8fd8-d1763302967f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:23.930109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5284ea-897e-4030-8fd8-d1763302967f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:23.930392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5284ea-897e-4030-8fd8-d1763302967f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:23.962046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:23.964134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:24.013098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc706b78-429d-4152-af1e-52f8e764906d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:24.055307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:24.057026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.057557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.058121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.059103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=fe7f20c75e5e43198e8f652b576f11c4) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:24.059659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:24.062032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:24.070685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 91/171] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:23 2022] GET /identity/v3/role_assignments?user.id=fe7f20c75e5e43198e8f652b576f11c4&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:24.072850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:24.096433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5284ea-897e-4030-8fd8-d1763302967f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:24.097942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5284ea-897e-4030-8fd8-d1763302967f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:24.222878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9c724-701b-4f15-80e8-e07c56327981 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:24.248769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:24.265822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be69991-2861-4e37-85e6-2f6d8311b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:24.266934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69991-2861-4e37-85e6-2f6d8311b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.272055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69991-2861-4e37-85e6-2f6d8311b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.272055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69991-2861-4e37-85e6-2f6d8311b2a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.279983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be69991-2861-4e37-85e6-2f6d8311b2a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0be69991-2861-4e37-85e6-2f6d8311b2a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:24.285532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:24.286448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:24.287199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:24.289592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 92/172] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:24.291697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644afd-509c-47d9-b5a0-f7885673e2df None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.292315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644afd-509c-47d9-b5a0-f7885673e2df None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.292826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644afd-509c-47d9-b5a0-f7885673e2df None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.294475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 93/173] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:24.296283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0644afd-509c-47d9-b5a0-f7885673e2df None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:24.378109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 81/174] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:24.384116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40438-7e93-4fb1-8a6c-9829aaf6582b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.384406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40438-7e93-4fb1-8a6c-9829aaf6582b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.384668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be40438-7e93-4fb1-8a6c-9829aaf6582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.416294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0644afd-509c-47d9-b5a0-f7885673e2df None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:24.425111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1be40438-7e93-4fb1-8a6c-9829aaf6582b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:24.427250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1be40438-7e93-4fb1-8a6c-9829aaf6582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:24.470222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:24.474147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.474147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.474147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.474147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:24.474147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:24.477277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:24.490495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 94/175] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:24.491759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:24.542796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:24.547767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:24.585861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 82/176] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:24.586940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40438-7e93-4fb1-8a6c-9829aaf6582b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:24.610321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a27ebb-0c0d-4713-8030-0c8da7397e20 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:24.649040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:24.649840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.650237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.650601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] PATH_INFO: `/v3/projects/2789458ff43b4091a5490fc47df09435` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.652038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] RBAC: Authorizing `identity:get_project(project_id=2789458ff43b4091a5490fc47df09435)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:24.653591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:24.655482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 95/177] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:24 2022] GET /identity/v3/projects/2789458ff43b4091a5490fc47df09435 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:24.661658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:24.789052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e8f90-866c-4282-a848-71bb65da7854 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:24.793524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be40438-7e93-4fb1-8a6c-9829aaf6582b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:24.806700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:24.841004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:24.841822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.842198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.842805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.843917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=2789458ff43b4091a5490fc47df09435, user.id=d31177bfd20d4a24b2ad2d6532971805) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:24.844340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:24.846196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:24.853592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 96/178] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:24 2022] GET /identity/v3/role_assignments?user.id=d31177bfd20d4a24b2ad2d6532971805&scope.project.id=2789458ff43b4091a5490fc47df09435&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:24.881387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:24.882064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:24.882348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:24.882624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] PATH_INFO: `/v3/users/d31177bfd20d4a24b2ad2d6532971805` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:24.884748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] RBAC: Authorizing `identity:get_user(user_id=d31177bfd20d4a24b2ad2d6532971805)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:24.886235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:24.888253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 83/179] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:24 2022] GET /identity/v3/users/d31177bfd20d4a24b2ad2d6532971805 => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:24.895183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:25.068442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b0ef0-0271-48a0-a81b-d6701b5fd4ad None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:25.089576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:25.113287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:25.113901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.114185 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.114453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.176561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:25.182335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:25.209350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:25.212006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:25.245731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164d009-8657-49d9-bada-21d88989f619 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:25.288376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:25.289033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.289311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.289585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.305826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:25.313788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:25.314712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:25.315954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:25.318328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 84/180] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:25.321490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:25.362179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 97/181] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:25.368000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:25.445466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb5a14-17a9-4e87-85ac-08f98db8232d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:25.455878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:25.465397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:25.486069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91f625-976d-4951-9344-498281281906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:25.486711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f625-976d-4951-9344-498281281906 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.486991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f625-976d-4951-9344-498281281906 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.487262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91f625-976d-4951-9344-498281281906 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.487998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91f625-976d-4951-9344-498281281906 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:25.488309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91f625-976d-4951-9344-498281281906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:25.489856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91f625-976d-4951-9344-498281281906 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:25.495244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5e8a4-606e-417b-9e7b-72b37373107f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:25.503302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 85/182] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:25.505076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9e411-45a8-4dca-a463-d3c3676ea5d7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.505360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9e411-45a8-4dca-a463-d3c3676ea5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.505633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9e411-45a8-4dca-a463-d3c3676ea5d7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.507109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 86/183] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:25.508109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd043-7fb6-4fb8-996f-7b08154ee94a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.508388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd043-7fb6-4fb8-996f-7b08154ee94a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.508657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfd043-7fb6-4fb8-996f-7b08154ee94a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.510304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 87/184] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:25.511033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd043-7fb6-4fb8-996f-7b08154ee94a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:25.546992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31e242-dd9c-4ea1-82c0-a2ccc06c267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:25.549277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e242-dd9c-4ea1-82c0-a2ccc06c267f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.549277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e242-dd9c-4ea1-82c0-a2ccc06c267f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.549277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e242-dd9c-4ea1-82c0-a2ccc06c267f None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.549552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31e242-dd9c-4ea1-82c0-a2ccc06c267f None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:25.551310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31e242-dd9c-4ea1-82c0-a2ccc06c267f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:25.552954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 98/185] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:25 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:25.554185 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df00f33-98b7-4578-b78e-ce25fe14d6de None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.554296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df00f33-98b7-4578-b78e-ce25fe14d6de None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.554560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df00f33-98b7-4578-b78e-ce25fe14d6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.587570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4df00f33-98b7-4578-b78e-ce25fe14d6de None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:25.589833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4df00f33-98b7-4578-b78e-ce25fe14d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:25.659451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfd043-7fb6-4fb8-996f-7b08154ee94a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:25.673923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 99/186] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:25.675425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427d84-e449-4e93-b19a-4060d27e40d7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.675697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427d84-e449-4e93-b19a-4060d27e40d7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.675971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b427d84-e449-4e93-b19a-4060d27e40d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.695902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7b427d84-e449-4e93-b19a-4060d27e40d7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:25.696913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7b427d84-e449-4e93-b19a-4060d27e40d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:25.710208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e4daa-1439-4902-922f-68410d38757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:25.710774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4daa-1439-4902-922f-68410d38757d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.711046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4daa-1439-4902-922f-68410d38757d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.711315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4daa-1439-4902-922f-68410d38757d None admin] PATH_INFO: `/v3/users/d95aac5e609c4d8c820311dc267051c1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.732548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e4daa-1439-4902-922f-68410d38757d None admin] RBAC: Authorizing `identity:get_user(user_id=d95aac5e609c4d8c820311dc267051c1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:25.734492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e4daa-1439-4902-922f-68410d38757d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:25.740865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 88/187] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:25 2022] GET /identity/v3/users/d95aac5e609c4d8c820311dc267051c1 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:25.740865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e4daa-1439-4902-922f-68410d38757d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:25.770360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:25.787093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 100/188] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:25.788832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c803688-cca0-415f-bfa4-6363cca4f329 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.789117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c803688-cca0-415f-bfa4-6363cca4f329 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.789384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c803688-cca0-415f-bfa4-6363cca4f329 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.791012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 101/189] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:25.791785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c803688-cca0-415f-bfa4-6363cca4f329 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:25.795019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:25.871908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e4daa-1439-4902-922f-68410d38757d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:25.929368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2d95e-9153-4a0d-ab99-fae991fda837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:25.930798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2d95e-9153-4a0d-ab99-fae991fda837 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.931922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2d95e-9153-4a0d-ab99-fae991fda837 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.932410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2d95e-9153-4a0d-ab99-fae991fda837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.933918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2d95e-9153-4a0d-ab99-fae991fda837 None admin] RBAC: Adding query filter params (role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=d31177bfd20d4a24b2ad2d6532971805) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:25.934630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2d95e-9153-4a0d-ab99-fae991fda837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:25.938417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2d95e-9153-4a0d-ab99-fae991fda837 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:25.951097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 89/190] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:25 2022] GET /identity/v3/role_assignments?user.id=d31177bfd20d4a24b2ad2d6532971805&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:25.954071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d40b-10fe-421d-a778-f8ec609d1657 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:25.954526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d40b-10fe-421d-a778-f8ec609d1657 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:25.954986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d40b-10fe-421d-a778-f8ec609d1657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:25.959801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c803688-cca0-415f-bfa4-6363cca4f329 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:25.982792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-09b9d40b-10fe-421d-a778-f8ec609d1657 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:25.985201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-09b9d40b-10fe-421d-a778-f8ec609d1657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:26.008703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.010053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.010522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.010945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.086616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 90/191] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:26.088143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9d40b-10fe-421d-a778-f8ec609d1657 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.120352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:26.121899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:26.124745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:26.129773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:26.237909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9d40b-10fe-421d-a778-f8ec609d1657 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:26.273421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 102/192] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:26.274584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.289075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.289732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.289999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.290885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.306453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:26.313779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:26.314723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:26.315525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 91/193] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:26.316987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.425654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:26.432888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb111012-4a34-4a23-8ced-00d9bfc65112 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:26.434677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:26.452579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578155e-2e3c-43e2-931f-4b8545b9556b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:26.481936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.483022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.483468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.483812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.497989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:26.503177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:26.504161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:26.504958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 103/194] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:26.505591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.515070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.515767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.516043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.516419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.517625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:26.519134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:26.520860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 92/195] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:26.521628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.649653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc7165-f507-433d-b9a7-6576baf5c009 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:26.673213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b67417-97cb-40d5-84ce-a8aa0aa1c726 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:26.695310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.695893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.696176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.696476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.697146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:26.697450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:26.698872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:26.709579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 104/196] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:26.710443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.724167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.724821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.725101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.725390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.726575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:26.728080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:26.729706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 93/197] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:26.731391 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.750561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:26.758038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:26.861412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc1292-846f-4509-8d28-f3324b75ed66 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:26.868641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c46ee-ff1d-4baa-bf7a-8ab128e52513 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:26.905766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.906463 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.906762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.907035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.907776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:26.908080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:26.909473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:26.918695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 105/198] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:26.919747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:26.920439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:26.921265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:26.921417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:26.921814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:26.922632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=d95aac5e609c4d8c820311dc267051c1) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:26.922945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:26.924515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:26.931253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 94/199] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/role_assignments?user.id=d95aac5e609c4d8c820311dc267051c1&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:26.932550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:27.076468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:27.082632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:27.110695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d348f-da15-4bab-81b4-4f84102ccf8a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:27.113762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b571d-454f-4b30-be35-88e3bb1ff2cc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:27.163121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:27.163661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:27.163737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:27.163978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] PATH_INFO: `/v3/users/88c8e377ca354cec96c7940f2a252d3e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:27.165443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] RBAC: Authorizing `identity:get_user(user_id=88c8e377ca354cec96c7940f2a252d3e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:27.167092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:27.167751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:27.168730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 106/200] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:26 2022] GET /identity/v3/users/88c8e377ca354cec96c7940f2a252d3e => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:27.169504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:27.173717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:27.174018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:27.174454 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:27.175070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:27.177076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:27.294425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 95/201] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:12:26 2022] POST /identity/v3/users => generated 297 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:27.295979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:27.321620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040526d8-243c-4339-b2e3-c9285395c7ed None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:27.373376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:27.375044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:27.375656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:27.376141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] PATH_INFO: `/v3/users/d95aac5e609c4d8c820311dc267051c1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:27.378535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] RBAC: Authorizing `identity:get_user(user_id=d95aac5e609c4d8c820311dc267051c1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:27.381765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:27.385053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 107/202] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:27 2022] GET /identity/v3/users/d95aac5e609c4d8c820311dc267051c1 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:27.392460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:27.427388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:27.479227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793447dc-4afa-4dfc-8def-bb5774509556 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:27.542061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:27.542061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:27.542061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:27.542061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:27.558382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:27.566483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522fa68-a0c8-4664-8072-08d4ccb07e04 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:27.627834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:27.628828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:27.629295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:27.630946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:27.662384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:27.664544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:27.733113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:27.734682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:27.766472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:27.816411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 96/203] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:27.823209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:27.871101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 108/204] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:27.878175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:27.906394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:28.049118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8dacd-8a44-4d55-b6d7-7355838a7d6f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:28.060458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8505d4-b13c-4edb-a845-c8a12da1c345 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:28.102323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:28.117297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:28.118105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:28.118387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:28.118662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:28.120034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:28.131239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:28.131239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 109/205] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:27 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:28.131239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:28.146122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:28.146782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:28.147067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:28.147371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:28.152086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:28.153585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:28.155731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 97/206] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:27 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:28.161936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:28.249853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cd526-2268-4574-9eba-8b09d4b5ba2a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:28.290334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3410bd-a992-4572-8481-58738b758718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:28.290948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3410bd-a992-4572-8481-58738b758718 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:28.291226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3410bd-a992-4572-8481-58738b758718 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:28.291532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3410bd-a992-4572-8481-58738b758718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:28.292586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3410bd-a992-4572-8481-58738b758718 None admin] RBAC: Adding query filter params (role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=d95aac5e609c4d8c820311dc267051c1) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:28.293027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3410bd-a992-4572-8481-58738b758718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:28.294722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3410bd-a992-4572-8481-58738b758718 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:28.306623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 110/207] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:28 2022] GET /identity/v3/role_assignments?user.id=d95aac5e609c4d8c820311dc267051c1&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:28.388819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cbd73-2623-4d58-83f6-bd0ecb9a0d62 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:28.402398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:28.449650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec6a7-e86c-4cd1-a0fc-2d93e27209b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:28.450288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec6a7-e86c-4cd1-a0fc-2d93e27209b3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:28.450568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec6a7-e86c-4cd1-a0fc-2d93e27209b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:28.450845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec6a7-e86c-4cd1-a0fc-2d93e27209b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:28.451714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec6a7-e86c-4cd1-a0fc-2d93e27209b3 None admin] RBAC: Adding query filter params (role.id=c56909e1368744ca8582c45b1328fb2b, scope.project.id=51f8a8823cda45c1925f2cae6377e284, user.id=88c8e377ca354cec96c7940f2a252d3e) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:28.452031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec6a7-e86c-4cd1-a0fc-2d93e27209b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:28.453530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec6a7-e86c-4cd1-a0fc-2d93e27209b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:28.465076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 98/208] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:28 2022] GET /identity/v3/role_assignments?user.id=88c8e377ca354cec96c7940f2a252d3e&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=c56909e1368744ca8582c45b1328fb2b => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:29.512280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782ab54-09fa-46e3-92c4-23a2e5e758aa None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:29.512800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782ab54-09fa-46e3-92c4-23a2e5e758aa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:29.512800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782ab54-09fa-46e3-92c4-23a2e5e758aa None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:29.514938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 111/209] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:29.520200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7352c3-a355-4c2b-8408-02a96181ed14 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:29.520624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7352c3-a355-4c2b-8408-02a96181ed14 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:29.520791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7352c3-a355-4c2b-8408-02a96181ed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:29.548377 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8a7352c3-a355-4c2b-8408-02a96181ed14 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:29.549587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a7352c3-a355-4c2b-8408-02a96181ed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:29.622685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 99/210] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:29.898711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782ab54-09fa-46e3-92c4-23a2e5e758aa None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:29.928771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4cfce-45c1-449c-853b-cb1e6c49552b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:29.929088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4cfce-45c1-449c-853b-cb1e6c49552b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:29.929306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4cfce-45c1-449c-853b-cb1e6c49552b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:29.931003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 100/211] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:29.936465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa78a-295d-4838-b7e9-72b23e64ffab None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:29.936738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa78a-295d-4838-b7e9-72b23e64ffab None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:29.937003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1caa78a-295d-4838-b7e9-72b23e64ffab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:29.955661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d1caa78a-295d-4838-b7e9-72b23e64ffab None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:29.956849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d1caa78a-295d-4838-b7e9-72b23e64ffab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:29.976298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:30.042475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 101/212] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:30.047599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782ab54-09fa-46e3-92c4-23a2e5e758aa None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.087395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd649945-ad26-4908-beeb-c9ff9181e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.087395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649945-ad26-4908-beeb-c9ff9181e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.087395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649945-ad26-4908-beeb-c9ff9181e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.087395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649945-ad26-4908-beeb-c9ff9181e4a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.097388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd649945-ad26-4908-beeb-c9ff9181e4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-bd649945-ad26-4908-beeb-c9ff9181e4a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:30.102850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:30.103741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:30.104559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 112/213] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:30.109940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa78a-295d-4838-b7e9-72b23e64ffab None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.142884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5cec-e2e1-4bf7-b5fb-61231907e72d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.143170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5cec-e2e1-4bf7-b5fb-61231907e72d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.143486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5cec-e2e1-4bf7-b5fb-61231907e72d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.143583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:30.144862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 113/214] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:30.153479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd670-532d-4472-9473-96a42429a17e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.153479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd670-532d-4472-9473-96a42429a17e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.153479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd670-532d-4472-9473-96a42429a17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.172389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a04fd670-532d-4472-9473-96a42429a17e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:30.173818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a04fd670-532d-4472-9473-96a42429a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:30.234650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1caa78a-295d-4838-b7e9-72b23e64ffab None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.253604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 114/215] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:30.275592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.276209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.276490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.276760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.277426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:30.277727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:30.279167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:30.288110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 102/216] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:30.293701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd670-532d-4472-9473-96a42429a17e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.334129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.352787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:30.424545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd670-532d-4472-9473-96a42429a17e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.440012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab725078-2e67-45b2-b975-1f18420665c8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.443862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:30.469153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.469798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.470076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.470350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] PATH_INFO: `/v3/users/d95aac5e609c4d8c820311dc267051c1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.471857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] RBAC: Authorizing `identity:get_user(user_id=d95aac5e609c4d8c820311dc267051c1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:30.473910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:30.479410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 115/217] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:30 2022] GET /identity/v3/users/d95aac5e609c4d8c820311dc267051c1 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:30.481034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.481343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.482089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.482577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.483733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.497320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:30.503562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:30.504425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:30.505201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:30.507582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 103/218] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:12:30.514058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.609945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768446-04a4-4546-abfe-b3444641ab2f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.626344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fe06e-2b64-4422-845f-2dfd1dd0c175 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.629377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:30.655848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.656556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.656829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.657094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.658258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:30.659827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:30.661657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 116/219] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:30 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:30.662230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.671536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.672401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.672580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.672833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.673496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:30.673795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:30.675219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:30.683725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 104/220] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:30.688518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.704156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:30.766912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d4dbc-ca98-4471-b746-770189302cc5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.792579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d5eb7-9c41-4ffc-97f0-17daf203f1f2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.801335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ea392-2f7c-4a58-a117-6da68e0ab346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.801965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ea392-2f7c-4a58-a117-6da68e0ab346 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.802243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ea392-2f7c-4a58-a117-6da68e0ab346 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.802512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ea392-2f7c-4a58-a117-6da68e0ab346 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.803651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ea392-2f7c-4a58-a117-6da68e0ab346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:30.806367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ea392-2f7c-4a58-a117-6da68e0ab346 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:30.806738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 117/221] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:30.807922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f1fb-e1cd-457c-94ac-62ab03c2e3c5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.808198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f1fb-e1cd-457c-94ac-62ab03c2e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.808473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f1fb-e1cd-457c-94ac-62ab03c2e3c5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.809689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 118/222] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:30.810445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f1fb-e1cd-457c-94ac-62ab03c2e3c5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.832589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.833251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.833565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.833790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/d95aac5e609c4d8c820311dc267051c1/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.835729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1dacb4fa7467990f4bd77bf2124e5, user_id=d95aac5e609c4d8c820311dc267051c1, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:30.837173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:30.861012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:30.910880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 105/223] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:30 2022] PUT /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/d95aac5e609c4d8c820311dc267051c1/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:30.911767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:30.912718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f1fb-e1cd-457c-94ac-62ab03c2e3c5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:30.973041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d07f4-0bce-4a18-83b6-d707e0aba32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:30.973615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d07f4-0bce-4a18-83b6-d707e0aba32c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:30.973934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d07f4-0bce-4a18-83b6-d707e0aba32c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:30.974208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d07f4-0bce-4a18-83b6-d707e0aba32c None admin] PATH_INFO: `/v3/users/9172989a6b984ccb848e2556c3dd02cb` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:30.990186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d07f4-0bce-4a18-83b6-d707e0aba32c None admin] RBAC: Authorizing `identity:get_user(user_id=9172989a6b984ccb848e2556c3dd02cb)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:30.991652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d07f4-0bce-4a18-83b6-d707e0aba32c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:30.998154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 119/224] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:30 2022] GET /identity/v3/users/9172989a6b984ccb848e2556c3dd02cb => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:30.999738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802b5b0-e152-4de1-86cc-a3d5dd662504 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.000026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802b5b0-e152-4de1-86cc-a3d5dd662504 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.000297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802b5b0-e152-4de1-86cc-a3d5dd662504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.007000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:31.020693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d802b5b0-e152-4de1-86cc-a3d5dd662504 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:31.021929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d802b5b0-e152-4de1-86cc-a3d5dd662504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:31.038352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ac29-4439-4acc-b7bd-b404bb15a485 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:31.087702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:31.088329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.088611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.089414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.089587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:31.091013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:31.105275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 120/225] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:31.106132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802b5b0-e152-4de1-86cc-a3d5dd662504 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:31.145005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:31.210938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 106/226] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:12:30 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:31.224335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802b5b0-e152-4de1-86cc-a3d5dd662504 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:31.267610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:31.268534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.269024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.269537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.350745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:31.352704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:31.391377 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:31.398242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:31.478132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 121/227] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:31.486425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:31.534593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda670fa-3cc2-4941-a963-807ff94319e6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:31.571010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:31.579453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:31.580365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.580540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.580758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.595070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:31.600822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:31.601691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:31.602482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 107/228] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:31.608018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:31.639768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba2da3-b1f5-4cd7-83a2-e4475c54d036 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:31.686715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:31.687605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.687889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.688168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.690827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:31.692756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:31.696074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 122/229] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:31 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:31.708966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:31.714009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:31.752635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dae68-7e50-4766-b1fd-c482f83090b1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:31.804145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:31.805299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.805299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.805680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.806477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:31.806897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:31.808440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:31.818669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 108/230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:31.824222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:31.851074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbecc26-d1c2-4d80-a689-f762dc358d80 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:31.885814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:31.897830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:31.898679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.899097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.900655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.900655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=9172989a6b984ccb848e2556c3dd02cb) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:31.900655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:31.902601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:31.910284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 123/231] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:31 2022] GET /identity/v3/role_assignments?user.id=9172989a6b984ccb848e2556c3dd02cb&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:31.944109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9ead3-b400-41ae-9def-4f8828f71b31 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:31.986223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:31.986965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:31.987282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:31.987592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] PATH_INFO: `/v3/users/d95aac5e609c4d8c820311dc267051c1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:31.988851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] RBAC: Authorizing `identity:get_user(user_id=d95aac5e609c4d8c820311dc267051c1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:31.990486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:31.992181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 109/232] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:31 2022] GET /identity/v3/users/d95aac5e609c4d8c820311dc267051c1 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:31.998035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:32.087382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:32.124440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1125b5-1d72-4a23-af08-f99791d17494 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:32.179433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275a2af-56be-41b4-92c0-ac0f59a04eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:32.180092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a2af-56be-41b4-92c0-ac0f59a04eac None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:32.180478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a2af-56be-41b4-92c0-ac0f59a04eac None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:32.180764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a2af-56be-41b4-92c0-ac0f59a04eac None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:32.184139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275a2af-56be-41b4-92c0-ac0f59a04eac None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:32.185634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275a2af-56be-41b4-92c0-ac0f59a04eac None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:32.188288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 124/233] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:31 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:32.193747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:32.321182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b1ffc-2bc5-48de-876c-ab3bddf48c86 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:32.349453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:32.376156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acc254-f245-4f2d-8abf-36ee55cf77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:32.376848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acc254-f245-4f2d-8abf-36ee55cf77bd None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:32.377130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acc254-f245-4f2d-8abf-36ee55cf77bd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:32.377405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acc254-f245-4f2d-8abf-36ee55cf77bd None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/d95aac5e609c4d8c820311dc267051c1/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:32.379793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acc254-f245-4f2d-8abf-36ee55cf77bd None admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1dacb4fa7467990f4bd77bf2124e5, user_id=d95aac5e609c4d8c820311dc267051c1, role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:32.381435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acc254-f245-4f2d-8abf-36ee55cf77bd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:32.457849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 110/234] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:32 2022] PUT /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/d95aac5e609c4d8c820311dc267051c1/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:33.345236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d25a7-a4fd-4f1e-9fd6-7463442da9c3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:33.345743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d25a7-a4fd-4f1e-9fd6-7463442da9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:33.345743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d25a7-a4fd-4f1e-9fd6-7463442da9c3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:33.347327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 125/235] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:33.359040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80da486-87ba-4d4b-815c-c5297de6609d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:33.359546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80da486-87ba-4d4b-815c-c5297de6609d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:33.359653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80da486-87ba-4d4b-815c-c5297de6609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:33.380175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e80da486-87ba-4d4b-815c-c5297de6609d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:33.381346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e80da486-87ba-4d4b-815c-c5297de6609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:33.453167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 111/236] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:33.728067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d25a7-a4fd-4f1e-9fd6-7463442da9c3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:33.835756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d25a7-a4fd-4f1e-9fd6-7463442da9c3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:33.872751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:33.874124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:33.874510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:33.874805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:33.877718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:33.886568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:33.892850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:33.893734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:33.895323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 126/237] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:33.900035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80da486-87ba-4d4b-815c-c5297de6609d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:34.017342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80da486-87ba-4d4b-815c-c5297de6609d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:34.033693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:34.066413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918a47d-cbe7-407c-b63d-3af576109b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:34.066413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a47d-cbe7-407c-b63d-3af576109b0f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.066413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a47d-cbe7-407c-b63d-3af576109b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.066413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918a47d-cbe7-407c-b63d-3af576109b0f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.067246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a47d-cbe7-407c-b63d-3af576109b0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:34.067246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a47d-cbe7-407c-b63d-3af576109b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:34.067545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918a47d-cbe7-407c-b63d-3af576109b0f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:34.082984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 112/238] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:34.088722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:34.239453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6651871-042c-4a83-b479-dd52d292b870 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:34.269024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a951a-fa00-4e8f-bab7-9913907a2034 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.269299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a951a-fa00-4e8f-bab7-9913907a2034 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.269500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a951a-fa00-4e8f-bab7-9913907a2034 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.271029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 113/239] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:34.277567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f06f0-0b4c-42f8-85f1-ff7b4f2983d3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.277969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f06f0-0b4c-42f8-85f1-ff7b4f2983d3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.278293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f06f0-0b4c-42f8-85f1-ff7b4f2983d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.285874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:34.286517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.286800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.287078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] PATH_INFO: `/v3/users/d95aac5e609c4d8c820311dc267051c1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.292095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] RBAC: Authorizing `identity:get_user(user_id=d95aac5e609c4d8c820311dc267051c1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:34.293605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:34.296248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 127/240] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:34 2022] GET /identity/v3/users/d95aac5e609c4d8c820311dc267051c1 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:34.298343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-159f06f0-0b4c-42f8-85f1-ff7b4f2983d3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:34.304363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-159f06f0-0b4c-42f8-85f1-ff7b4f2983d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:34.305193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:34.393247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:34.434793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b11975-1b17-49a4-8669-9c6f90971477 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:34.468933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 114/241] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:34.470218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038b5d-9f76-4696-a9b1-09768fc15667 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.470501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038b5d-9f76-4696-a9b1-09768fc15667 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.470769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038b5d-9f76-4696-a9b1-09768fc15667 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.476562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 115/242] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:34.484337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47354-9f05-41a9-b1e5-a1f7ee15efbc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.485683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47354-9f05-41a9-b1e5-a1f7ee15efbc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.486308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47354-9f05-41a9-b1e5-a1f7ee15efbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.496644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:34.497566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.498083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.498886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.516541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2ee47354-9f05-41a9-b1e5-a1f7ee15efbc None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:34.518090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ee47354-9f05-41a9-b1e5-a1f7ee15efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:34.641548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 116/243] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:34.672974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:34.675519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:34.767705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:34.806154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee47354-9f05-41a9-b1e5-a1f7ee15efbc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:34.822838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 128/244] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 12:12:34.828596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:34.892841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:34.957231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876e649-11d5-4a5b-bea3-c3bc67dc134b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:34.990072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee47354-9f05-41a9-b1e5-a1f7ee15efbc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:34.994510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a74363-b5a0-457b-9afb-4f909f1ae7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:34.995151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74363-b5a0-457b-9afb-4f909f1ae7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:34.995456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74363-b5a0-457b-9afb-4f909f1ae7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:34.995802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a74363-b5a0-457b-9afb-4f909f1ae7b2 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:34.996971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74363-b5a0-457b-9afb-4f909f1ae7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:34.999440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a74363-b5a0-457b-9afb-4f909f1ae7b2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:35.001947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 129/245] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:34 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:35.003229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0230d-a71f-43c5-b4a0-429076d5536e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.003528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0230d-a71f-43c5-b4a0-429076d5536e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.003799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0230d-a71f-43c5-b4a0-429076d5536e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.005205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 130/246] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:35.008123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0230d-a71f-43c5-b4a0-429076d5536e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:35.036685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.037329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.037603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.037875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.047583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:35.051956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:35.057069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:35.057976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:35.058796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 117/247] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:35.059470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:35.142541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0230d-a71f-43c5-b4a0-429076d5536e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:35.163738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:35.173121 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82c61c-e7c8-469e-84ca-6939332445c6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:35.181213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793bc89-abe6-4476-bca8-e8793fc65121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.183768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793bc89-abe6-4476-bca8-e8793fc65121 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.183768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793bc89-abe6-4476-bca8-e8793fc65121 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.183768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793bc89-abe6-4476-bca8-e8793fc65121 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.183768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793bc89-abe6-4476-bca8-e8793fc65121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:35.185029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793bc89-abe6-4476-bca8-e8793fc65121 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:35.187728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 131/248] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:35.192459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d30f54-5bf9-4c51-8e97-169c8b6045c3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.192742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d30f54-5bf9-4c51-8e97-169c8b6045c3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.193050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d30f54-5bf9-4c51-8e97-169c8b6045c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.212256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f5d30f54-5bf9-4c51-8e97-169c8b6045c3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:35.213449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f5d30f54-5bf9-4c51-8e97-169c8b6045c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:35.221714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.222339 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.222591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.222857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.223606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=d95aac5e609c4d8c820311dc267051c1) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:35.223912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:35.225338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:35.231590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 118/249] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:35 2022] GET /identity/v3/role_assignments?user.id=d95aac5e609c4d8c820311dc267051c1&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:35.236327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:35.311430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 132/250] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:35.311430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d30f54-5bf9-4c51-8e97-169c8b6045c3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:35.350519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:35.438518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dd43b-cc39-48ab-8753-279ba481c5bd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:35.480892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d30f54-5bf9-4c51-8e97-169c8b6045c3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:35.488645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8863de-0bfe-4ec3-8664-f44c88bf290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.489285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8863de-0bfe-4ec3-8664-f44c88bf290c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.489545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8863de-0bfe-4ec3-8664-f44c88bf290c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.489817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8863de-0bfe-4ec3-8664-f44c88bf290c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.490497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8863de-0bfe-4ec3-8664-f44c88bf290c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:35.490798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8863de-0bfe-4ec3-8664-f44c88bf290c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:35.493118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8863de-0bfe-4ec3-8664-f44c88bf290c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:35.505539 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 119/251] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:35.507229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f16954-4698-41bd-a7fc-4261f110793f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.507652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f16954-4698-41bd-a7fc-4261f110793f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.508019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f16954-4698-41bd-a7fc-4261f110793f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.514287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 120/252] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:35.515335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f16954-4698-41bd-a7fc-4261f110793f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:35.526394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdd40-f373-4a2a-9b04-73c7abbb4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.527294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdd40-f373-4a2a-9b04-73c7abbb4cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.527617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdd40-f373-4a2a-9b04-73c7abbb4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.527885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdd40-f373-4a2a-9b04-73c7abbb4cf5 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.528544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdd40-f373-4a2a-9b04-73c7abbb4cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:35.530293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdd40-f373-4a2a-9b04-73c7abbb4cf5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:35.558699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:35.641227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 133/253] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:12:35 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:35.642700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db80e-b649-446f-b65d-f069f04cf0b4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.643050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db80e-b649-446f-b65d-f069f04cf0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.643517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db80e-b649-446f-b65d-f069f04cf0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.655968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f16954-4698-41bd-a7fc-4261f110793f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:35.667542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-365db80e-b649-446f-b65d-f069f04cf0b4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:35.669206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-365db80e-b649-446f-b65d-f069f04cf0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:35.698125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.698721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.698996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.699275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] PATH_INFO: `/v3/users/9792fa33073a4cc58b5bbaacfd21f9ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.715777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] RBAC: Authorizing `identity:get_user(user_id=9792fa33073a4cc58b5bbaacfd21f9ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:35.717940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:35.720731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 121/254] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:35 2022] GET /identity/v3/users/9792fa33073a4cc58b5bbaacfd21f9ea => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:35.721831 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:35.763392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 134/255] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:35.765824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db80e-b649-446f-b65d-f069f04cf0b4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:35.787219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:35.840121 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:35.870980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d103b-fe10-4c10-afe8-385417c8a329 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:35.893408 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db80e-b649-446f-b65d-f069f04cf0b4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:35.927030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.927711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.927988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.928255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.941238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:35.941859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:35.942133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:35.942401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:35.946119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:35.951063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:35.953070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:35.953854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 122/256] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:35.960408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.040167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.042374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.063729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:36.088986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91028d-8ea2-43b4-8bd3-aa6e60e107c1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.136089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.137543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.137829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.138101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.139679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:36.140011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.141535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.144127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:36.151308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 123/257] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:36.154642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.173533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 135/258] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:36.174395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.276644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc6a0-1e62-4b88-908e-a07fddf0d5bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.299250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7091e76-c7ec-4e32-9d39-8dc2eb37645d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.318323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:36.327812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.328753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.329287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.329725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.338558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.339584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.339864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.340134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] PATH_INFO: `/v3/users/9172989a6b984ccb848e2556c3dd02cb` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.341361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] RBAC: Authorizing `identity:get_user(user_id=9172989a6b984ccb848e2556c3dd02cb)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.342918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.343558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:36.349180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 136/259] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/users/9172989a6b984ccb848e2556c3dd02cb => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:36.349767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:36.350666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:36.351476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:36.353035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.353109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 124/260] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:36.354719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.431336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:36.460987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870c07b-6333-48d4-9629-b0cb3759cf77 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.480736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21899ce-1675-4518-8813-90a44868e62e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.496839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.497493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.497733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.498000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.499492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.500923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.503011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 137/261] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:36.503818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.525032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.526549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.527156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.527652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.529055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.531376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.533632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 125/262] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:36.534668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.566229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:36.614856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6057c-af0a-46a2-acb2-331b14796a15 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.651590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.652236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.652510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.652794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.653449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:36.653748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.655934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.659312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0b959-deb4-42d9-a864-302bdd566751 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.669425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 138/263] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:36.669425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.694936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:36.706110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.707207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.707722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.708249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.709203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] RBAC: Adding query filter params (role.id=c56909e1368744ca8582c45b1328fb2b, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=9792fa33073a4cc58b5bbaacfd21f9ea) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:36.709724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.711545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.720118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 126/264] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/role_assignments?user.id=9792fa33073a4cc58b5bbaacfd21f9ea&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=c56909e1368744ca8582c45b1328fb2b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:36.721832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.787436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522d6cb-d236-464b-8a44-17760e2a81f6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.811715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:36.847271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.848567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.849062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.849651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/9172989a6b984ccb848e2556c3dd02cb/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.853340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1dacb4fa7467990f4bd77bf2124e5, user_id=9172989a6b984ccb848e2556c3dd02cb, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.855875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.861697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f5ddc-cae4-4c84-a351-52e7d0ec4d68 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:36.909802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:36.910977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:36.911583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:36.912107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] PATH_INFO: `/v3/users/d95aac5e609c4d8c820311dc267051c1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:36.913900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] RBAC: Authorizing `identity:get_user(user_id=d95aac5e609c4d8c820311dc267051c1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:36.916062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:36.918776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 127/265] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/users/d95aac5e609c4d8c820311dc267051c1 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:36.925672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:36.944828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 139/266] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:36 2022] PUT /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/9172989a6b984ccb848e2556c3dd02cb/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:37.004153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:37.060056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8c8c-5379-48e8-b750-07c55c69e686 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:37.103879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:37.104521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:37.104804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:37.105080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:37.196913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:37.198422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:37.264958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:37.318271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 128/267] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:37.324199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:37.475245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbb0f3-534b-48a0-b20a-daba820a1225 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:37.518396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856276b4-64e7-4105-ab6b-4923b7a8e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:37.519888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856276b4-64e7-4105-ab6b-4923b7a8e122 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:37.520371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856276b4-64e7-4105-ab6b-4923b7a8e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:37.520859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856276b4-64e7-4105-ab6b-4923b7a8e122 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:37.522431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856276b4-64e7-4105-ab6b-4923b7a8e122 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:37.524111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856276b4-64e7-4105-ab6b-4923b7a8e122 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:37.525948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 140/268] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:37 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:37.532841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:37.678618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37207f1-429a-4f64-9399-be4940f7e3ed None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:37.716351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94c7e4-0f30-4617-b7fb-691cc58ca5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:37.717507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c7e4-0f30-4617-b7fb-691cc58ca5ac None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:37.717792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c7e4-0f30-4617-b7fb-691cc58ca5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:37.718067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94c7e4-0f30-4617-b7fb-691cc58ca5ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:37.719007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94c7e4-0f30-4617-b7fb-691cc58ca5ac None admin] RBAC: Adding query filter params (role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=d95aac5e609c4d8c820311dc267051c1) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:37.719318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94c7e4-0f30-4617-b7fb-691cc58ca5ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:37.720826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94c7e4-0f30-4617-b7fb-691cc58ca5ac None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:37.727575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 129/269] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:37 2022] GET /identity/v3/role_assignments?user.id=d95aac5e609c4d8c820311dc267051c1&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:38.386621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775315f6-6d75-445c-a441-4b9c92aa0fd8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:38.387592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775315f6-6d75-445c-a441-4b9c92aa0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:38.388080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775315f6-6d75-445c-a441-4b9c92aa0fd8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:38.390446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 141/270] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:38.396432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669df50-a13c-4133-bf31-48f282a461c1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:38.396718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669df50-a13c-4133-bf31-48f282a461c1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:38.396992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669df50-a13c-4133-bf31-48f282a461c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:38.400949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d330-4294-496d-92ca-87a4c02e916b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:38.401236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d330-4294-496d-92ca-87a4c02e916b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:38.401511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23d330-4294-496d-92ca-87a4c02e916b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:38.402823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 142/271] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:38.408208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a42fe-3e25-4120-8178-f8a42a85abaf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:38.408485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a42fe-3e25-4120-8178-f8a42a85abaf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:38.408756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a42fe-3e25-4120-8178-f8a42a85abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:38.421959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4669df50-a13c-4133-bf31-48f282a461c1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:38.423595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4669df50-a13c-4133-bf31-48f282a461c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:38.437922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d42a42fe-3e25-4120-8178-f8a42a85abaf None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:38.439271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d42a42fe-3e25-4120-8178-f8a42a85abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:38.444048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:38.481223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:38.501175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 130/272] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:38.518201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 143/273] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:38.772808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669df50-a13c-4133-bf31-48f282a461c1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:38.792720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a42fe-3e25-4120-8178-f8a42a85abaf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:38.891785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669df50-a13c-4133-bf31-48f282a461c1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:38.920521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a42fe-3e25-4120-8178-f8a42a85abaf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:38.929322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:38.930066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:38.930348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:38.930623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:38.931953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:38.933534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:38.935418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 131/274] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:38.941910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:38.961000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:38.962022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:38.962425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:38.962836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:38.968640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:38.975805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:38.982380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:38.990140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:38.991125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 144/275] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:12:38.993165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:39.037669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:39.082474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63b9b-340b-4663-81a1-301d08c8073e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:39.124018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:39.124405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.124704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.124978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.125653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:39.127115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:39.140440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd14f4f-3077-4824-bf62-b8688228290a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:39.178025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:39.178983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.179535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.180005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.180865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:39.181384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:39.182946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:39.193689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 145/276] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:39.201559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 132/277] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:12:38 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:12:39.203330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:39.319632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:39.328640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108545a-2358-4e52-bb34-77e794ac3991 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:39.370198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e5bf5-b6ad-4307-afbf-8d20e39d0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:39.370847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5bf5-b6ad-4307-afbf-8d20e39d0922 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.371129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5bf5-b6ad-4307-afbf-8d20e39d0922 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.371435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e5bf5-b6ad-4307-afbf-8d20e39d0922 None admin] PATH_INFO: `/v3/users/6ed3577ac55145bd912f0e65b234f8a2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.390146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e5bf5-b6ad-4307-afbf-8d20e39d0922 None admin] RBAC: Authorizing `identity:get_user(user_id=6ed3577ac55145bd912f0e65b234f8a2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:39.391854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e5bf5-b6ad-4307-afbf-8d20e39d0922 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:39.393890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 146/278] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:39 2022] GET /identity/v3/users/6ed3577ac55145bd912f0e65b234f8a2 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:39.399884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:39.490731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:39.505245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20596e1-f30b-46ee-a8a5-5429ae29e2b8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.505866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20596e1-f30b-46ee-a8a5-5429ae29e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.506368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20596e1-f30b-46ee-a8a5-5429ae29e2b8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.509386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 147/279] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:39.515793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd125a-af55-484f-a162-c24a64644d21 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.516101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd125a-af55-484f-a162-c24a64644d21 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.516340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd125a-af55-484f-a162-c24a64644d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.522883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54760c5-cea5-4a8e-a758-95425b857d33 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:39.541113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-08bd125a-af55-484f-a162-c24a64644d21 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:39.542400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-08bd125a-af55-484f-a162-c24a64644d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:39.629880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 148/280] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:39.632173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130c2b-348b-42c8-8726-4886e38d4c45 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.632625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130c2b-348b-42c8-8726-4886e38d4c45 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.633374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130c2b-348b-42c8-8726-4886e38d4c45 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.634763 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 149/281] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:39.640931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80c524-c206-4eeb-803d-89cd206af572 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.641210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80c524-c206-4eeb-803d-89cd206af572 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.641480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80c524-c206-4eeb-803d-89cd206af572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.641809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:39.642428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:39.642721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:39.642967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:39.643794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, user.id=6ed3577ac55145bd912f0e65b234f8a2, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:39.644101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:39.645532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:39.654025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 133/282] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Sep 26 12:12:39 2022] GET /identity/v3/role_assignments?user.id=6ed3577ac55145bd912f0e65b234f8a2&scope.system=all&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:39.668294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1a80c524-c206-4eeb-803d-89cd206af572 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:39.670777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1a80c524-c206-4eeb-803d-89cd206af572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:39.760417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 150/283] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:39.939659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.078107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80c524-c206-4eeb-803d-89cd206af572 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.094321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03678c44-5bdc-4fe9-b27f-218be8876255 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:40.094934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:40.139575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:40.140341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:40.140563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:40.140835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:40.163725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:40.165184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:40.173246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:40.176968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:40.177950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 134/284] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:40.180849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.284157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80c524-c206-4eeb-803d-89cd206af572 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:40.349972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:40.350236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:40.350522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:40.350800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:40.371776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954ce9f-3b14-4261-b80c-42d1707d6c01 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:40.375740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:40.382286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:40.383446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:40.384457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:40.392706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 151/285] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:12:40.401725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.429277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:40.430018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:40.430373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:40.431134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:40.431930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:40.433664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:40.433926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:40.445143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 135/286] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:40.451883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.513222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:40.546861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eed57-b214-49b7-8a7d-3347e4513ae8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:40.584858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:40.590481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:40.591447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:40.592843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:40.593444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:40.594347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:40.594836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:40.596464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:40.606802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 152/287] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:40.613843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.673120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22567d-0d9e-4bed-aaed-51fe08a24a53 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:40.752085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:40.752740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:40.753017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:40.753291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] PATH_INFO: `/v3/users/9792fa33073a4cc58b5bbaacfd21f9ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:40.754495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] RBAC: Authorizing `identity:get_user(user_id=9792fa33073a4cc58b5bbaacfd21f9ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:40.755978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:40.762358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 136/288] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:40 2022] GET /identity/v3/users/9792fa33073a4cc58b5bbaacfd21f9ea => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:40.765685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.799144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a861fc2-68f1-4021-9ab6-df7cf91a152b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:40.865357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:40.866362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:40.866853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:40.867501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] PATH_INFO: `/v3/users/9172989a6b984ccb848e2556c3dd02cb` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:40.869017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] RBAC: Authorizing `identity:get_user(user_id=9172989a6b984ccb848e2556c3dd02cb)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:40.870715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:40.872612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 153/289] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:40 2022] GET /identity/v3/users/9172989a6b984ccb848e2556c3dd02cb => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:40.884418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:40.888014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:40.924924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c07e2-57f3-41ef-9210-4faf0b0eab24 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:40.969123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:40.986522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:40.987199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:40.987507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:40.987778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:40.989053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:40.990528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:40.993291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 137/290] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:40 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:41.002790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:41.100380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5c257-9dd1-48e9-81c7-c71ebba3b9df None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:41.176610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c37e0-ccef-43a6-bb4e-0d41d9bca289 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:41.184083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:41.185008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:41.186063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:41.186566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:41.223362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:41.224595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:41.225929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:41.229000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/9792fa33073a4cc58b5bbaacfd21f9ea/roles/c56909e1368744ca8582c45b1328fb2b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:41.231392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1dacb4fa7467990f4bd77bf2124e5, user_id=9792fa33073a4cc58b5bbaacfd21f9ea, role_id=c56909e1368744ca8582c45b1328fb2b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:41.234619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:41.288151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:41.290178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:41.292453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:41.337757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 138/291] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:12:41 2022] PUT /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/users/9792fa33073a4cc58b5bbaacfd21f9ea/roles/c56909e1368744ca8582c45b1328fb2b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:41.422687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 154/292] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:41.428495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:41.537673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:41.589137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde54cd7-4951-4850-b3dd-7ba291815f39 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:41.628918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b0344-a85d-473e-ab89-bede5d0199b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:41.629940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0344-a85d-473e-ab89-bede5d0199b3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:41.630430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0344-a85d-473e-ab89-bede5d0199b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:41.630908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b0344-a85d-473e-ab89-bede5d0199b3 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:41.632311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b0344-a85d-473e-ab89-bede5d0199b3 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:41.633968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b0344-a85d-473e-ab89-bede5d0199b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:41.635845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 139/293] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:41 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:41.644493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:41.795382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ff6d4-ee46-461f-a6d2-fdcc79885885 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:41.797085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:41.861075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b9d31-09ec-4cc0-aa0b-c01aa0ca2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:41.861708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9d31-09ec-4cc0-aa0b-c01aa0ca2382 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:41.861990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9d31-09ec-4cc0-aa0b-c01aa0ca2382 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:41.862268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b9d31-09ec-4cc0-aa0b-c01aa0ca2382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:41.863010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b9d31-09ec-4cc0-aa0b-c01aa0ca2382 None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=9172989a6b984ccb848e2556c3dd02cb) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:41.863322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b9d31-09ec-4cc0-aa0b-c01aa0ca2382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:41.864780 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b9d31-09ec-4cc0-aa0b-c01aa0ca2382 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:41.875714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 155/294] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:41 2022] GET /identity/v3/role_assignments?user.id=9172989a6b984ccb848e2556c3dd02cb&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:42.208907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d283a-6a2a-464f-b5ba-bd0463d29c2a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.209420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d283a-6a2a-464f-b5ba-bd0463d29c2a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.209420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d283a-6a2a-464f-b5ba-bd0463d29c2a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.210716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 140/295] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:42.218263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba023fc-0220-493b-9673-68e528c405f1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.218782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba023fc-0220-493b-9673-68e528c405f1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.218782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba023fc-0220-493b-9673-68e528c405f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.239647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e40068-c38d-44a0-8f0f-04f44fa613ce None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.239977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e40068-c38d-44a0-8f0f-04f44fa613ce None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.240192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e40068-c38d-44a0-8f0f-04f44fa613ce None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.241790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 141/296] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:42.245305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-eba023fc-0220-493b-9673-68e528c405f1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:42.246552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eba023fc-0220-493b-9673-68e528c405f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:42.248353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a786976-51f6-43b6-bc61-6fd8090f2e64 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.248842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a786976-51f6-43b6-bc61-6fd8090f2e64 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.249271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a786976-51f6-43b6-bc61-6fd8090f2e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.275798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1a786976-51f6-43b6-bc61-6fd8090f2e64 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:42.277020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1a786976-51f6-43b6-bc61-6fd8090f2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:42.343304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 156/297] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:42.368046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe4dd6-bd18-4dc9-8e46-760ee4c97be2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.368656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe4dd6-bd18-4dc9-8e46-760ee4c97be2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.369164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe4dd6-bd18-4dc9-8e46-760ee4c97be2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.371049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 157/298] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:42.378146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c5efb-1f1a-4d8d-b877-e134ae7f224a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.378731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c5efb-1f1a-4d8d-b877-e134ae7f224a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.379212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c5efb-1f1a-4d8d-b877-e134ae7f224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.401588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 142/299] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:42.406401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3a3c5efb-1f1a-4d8d-b877-e134ae7f224a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:42.406542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3a3c5efb-1f1a-4d8d-b877-e134ae7f224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:42.489904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 158/300] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:42.647041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a786976-51f6-43b6-bc61-6fd8090f2e64 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:42.691425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c5efb-1f1a-4d8d-b877-e134ae7f224a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:42.710488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:42.722850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:42.772124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a786976-51f6-43b6-bc61-6fd8090f2e64 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:42.806746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c5efb-1f1a-4d8d-b877-e134ae7f224a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:42.811078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:42.812202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.812632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.813052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.814368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:42.816528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:42.819554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 143/301] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:42.820607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:42.848641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:42.849304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.849608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.849882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.861501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:42.866529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:42.867719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 159/302] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:12:42.868704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:42.941288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbd6b9-de39-4165-99a2-e773abe92db4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:42.965646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:42.967715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:42.976744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:42.977372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:42.977648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:42.977921 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:42.984282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b322e-92ef-415f-906c-0830cef4b58c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:42.989166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:42.996753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:42.997745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 144/303] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:42.999303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:43.026257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:43.026783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.027056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.027323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] PATH_INFO: `/v3/groups` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.027977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:43.029609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:43.105776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38775-b648-4091-a9bb-8cb25e0bbba7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:43.126316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 160/304] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Sep 26 12:12:42 2022] POST /identity/v3/groups => generated 229 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:43.127457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:43.153088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:43.154787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.155285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.155960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.156847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:43.157385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:43.159298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:43.174420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 145/305] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:43.175664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:43.251153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:43.273194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8055751-cedb-49e3-8983-de624b439ded None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:43.320045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:43.320584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.320950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.321140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.321822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:43.322126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:43.324152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:43.339335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5852f5-1521-430f-863a-7d3e47f7e694 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:43.343281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 161/306] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:43.349177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:43.362405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:43.384543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:43.385196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.385479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.385751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] PATH_INFO: `/v3/users/6ed3577ac55145bd912f0e65b234f8a2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.387307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=6ed3577ac55145bd912f0e65b234f8a2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:43.390189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:43.396413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 146/307] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:43 2022] GET /identity/v3/users/6ed3577ac55145bd912f0e65b234f8a2 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:43.398239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:43.476090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddad6b-e4d9-4d22-96de-2b3d4ffb29c3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:43.522246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:43.523310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.523932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.524625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] PATH_INFO: `/v3/users/3da49d61a1614811ba100725ee8afbfd` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.536043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce5f83-6af4-4000-b620-6de2d3a56fe0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:43.541637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] RBAC: Authorizing `identity:get_user(user_id=3da49d61a1614811ba100725ee8afbfd)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:43.544099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:43.545868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 162/308] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:43 2022] GET /identity/v3/users/3da49d61a1614811ba100725ee8afbfd => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:43.555378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:43.555554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:43.582089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3c1e9-0f95-48c0-859b-279e800a573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:43.583162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c1e9-0f95-48c0-859b-279e800a573e None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.583747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c1e9-0f95-48c0-859b-279e800a573e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.584032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3c1e9-0f95-48c0-859b-279e800a573e None admin] PATH_INFO: `/v3/system/users/6ed3577ac55145bd912f0e65b234f8a2/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.586169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3c1e9-0f95-48c0-859b-279e800a573e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6ed3577ac55145bd912f0e65b234f8a2, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:43.588150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3c1e9-0f95-48c0-859b-279e800a573e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:43.628859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:43.667178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34854e86-b431-427c-8091-c8c6657db08e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:43.670312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 147/309] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Sep 26 12:12:43 2022] PUT /identity/v3/system/users/6ed3577ac55145bd912f0e65b234f8a2/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:12:43.726567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c9228-2496-46ee-8a73-e4c46baac099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:43.727250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9228-2496-46ee-8a73-e4c46baac099 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.727551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9228-2496-46ee-8a73-e4c46baac099 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.727870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9228-2496-46ee-8a73-e4c46baac099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.728652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9228-2496-46ee-8a73-e4c46baac099 None admin] RBAC: Adding query filter params (role.id=c56909e1368744ca8582c45b1328fb2b, user.id=3da49d61a1614811ba100725ee8afbfd, scope.system=all) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:43.729015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9228-2496-46ee-8a73-e4c46baac099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:43.730572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c9228-2496-46ee-8a73-e4c46baac099 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:43.738278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 163/310] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Sep 26 12:12:43 2022] GET /identity/v3/role_assignments?user.id=3da49d61a1614811ba100725ee8afbfd&scope.system=all&role.id=c56909e1368744ca8582c45b1328fb2b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:43.843961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e78c-93b9-4c73-940e-0a95fa51a166 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.844143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e78c-93b9-4c73-940e-0a95fa51a166 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.844413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e78c-93b9-4c73-940e-0a95fa51a166 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.846281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 148/311] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:43.852416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e06dc-51a2-4956-a06a-4c4b794d0b43 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:43.852721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e06dc-51a2-4956-a06a-4c4b794d0b43 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:43.852975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e06dc-51a2-4956-a06a-4c4b794d0b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:43.875203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ba4e06dc-51a2-4956-a06a-4c4b794d0b43 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:43.876472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ba4e06dc-51a2-4956-a06a-4c4b794d0b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:43.956550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 164/312] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:44.230776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e78c-93b9-4c73-940e-0a95fa51a166 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:44.345494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e78c-93b9-4c73-940e-0a95fa51a166 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:44.383508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:44.384519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:44.385005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:44.385511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:44.397511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:44.402684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:44.403597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:44.404962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:44.407163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 149/313] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:44.414994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e06dc-51a2-4956-a06a-4c4b794d0b43 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:44.479920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:44.523194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e06dc-51a2-4956-a06a-4c4b794d0b43 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:44.558942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:44.559583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:44.559857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:44.560123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:44.560999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:44.561343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:44.562664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:44.571864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 165/314] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:44.577981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:44.622354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:44.692537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bd08-fc78-4294-bd5a-efea3de3bb0b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:44.734493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:44.735167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:44.735553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:44.735840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] PATH_INFO: `/v3/users/9792fa33073a4cc58b5bbaacfd21f9ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:44.737066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] RBAC: Authorizing `identity:get_user(user_id=9792fa33073a4cc58b5bbaacfd21f9ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:44.738754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:44.740541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 150/315] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:44 2022] GET /identity/v3/users/9792fa33073a4cc58b5bbaacfd21f9ea => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:44.746255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:44.856135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8041816-c66e-4dc4-892a-bad1141a2ef0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:44.879672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:44.891531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:44.892195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:44.892473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:44.892743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:44.962415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:44.963945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:45.066841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 166/316] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:45.073592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:45.184972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256ea13-1912-46f8-9e95-3ceec72d4999 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:45.193286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:45.221412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a191f-ea16-4180-87c8-ab9c3a8ea721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:45.222496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a191f-ea16-4180-87c8-ab9c3a8ea721 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:45.223061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a191f-ea16-4180-87c8-ab9c3a8ea721 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:45.223558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a191f-ea16-4180-87c8-ab9c3a8ea721 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:45.224920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a191f-ea16-4180-87c8-ab9c3a8ea721 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:45.226564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a191f-ea16-4180-87c8-ab9c3a8ea721 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:45.228735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 151/317] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:45 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:45.235218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:45.260094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:45.349472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbadde-fc64-498f-88fc-b2767387648c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:45.386126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057a0b6-c79c-4778-8f29-3a8e7f536c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:45.387074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a0b6-c79c-4778-8f29-3a8e7f536c9d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:45.387391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a0b6-c79c-4778-8f29-3a8e7f536c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:45.387664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057a0b6-c79c-4778-8f29-3a8e7f536c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:45.388898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a0b6-c79c-4778-8f29-3a8e7f536c9d None admin] RBAC: Adding query filter params (role.id=c56909e1368744ca8582c45b1328fb2b, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5, user.id=9792fa33073a4cc58b5bbaacfd21f9ea) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:45.389255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a0b6-c79c-4778-8f29-3a8e7f536c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:45.390664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057a0b6-c79c-4778-8f29-3a8e7f536c9d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:45.396619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 167/318] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:12:45 2022] GET /identity/v3/role_assignments?user.id=9792fa33073a4cc58b5bbaacfd21f9ea&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=c56909e1368744ca8582c45b1328fb2b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:45.453443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085831-4655-4e73-95ea-d5a0cf7ea57f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:45.453956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085831-4655-4e73-95ea-d5a0cf7ea57f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:45.453956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085831-4655-4e73-95ea-d5a0cf7ea57f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:45.455392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 152/319] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:45.461649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4a71-5ff0-40cd-8170-75e84038bd50 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:45.462555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4a71-5ff0-40cd-8170-75e84038bd50 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:45.462975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb4a71-5ff0-40cd-8170-75e84038bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:45.484461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-31eb4a71-5ff0-40cd-8170-75e84038bd50 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:45.485893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-31eb4a71-5ff0-40cd-8170-75e84038bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:45.562711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 168/320] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:45.838321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085831-4655-4e73-95ea-d5a0cf7ea57f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:45.947805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085831-4655-4e73-95ea-d5a0cf7ea57f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:45.988915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f940245-8b2f-4161-9c53-da6e9a16488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:45.989587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f940245-8b2f-4161-9c53-da6e9a16488a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:45.989868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f940245-8b2f-4161-9c53-da6e9a16488a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:45.990142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f940245-8b2f-4161-9c53-da6e9a16488a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:45.991508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f940245-8b2f-4161-9c53-da6e9a16488a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:45.993096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f940245-8b2f-4161-9c53-da6e9a16488a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:45.995069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 153/321] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:12:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:46.001145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb4a71-5ff0-40cd-8170-75e84038bd50 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:46.020431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:46.094882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820453-c3ec-4527-b692-0bb8f91b8e9d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.095086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820453-c3ec-4527-b692-0bb8f91b8e9d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.095393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820453-c3ec-4527-b692-0bb8f91b8e9d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.096733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 154/322] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:46.097797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52a293-48fb-4c13-8b76-5ce6ab65363f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.098128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52a293-48fb-4c13-8b76-5ce6ab65363f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.098401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52a293-48fb-4c13-8b76-5ce6ab65363f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.099708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 155/323] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:46.102138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d563-bccc-47ed-818a-97c509777cc4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.102398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d563-bccc-47ed-818a-97c509777cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.102672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d563-bccc-47ed-818a-97c509777cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.106944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb4a71-5ff0-40cd-8170-75e84038bd50 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:46.121366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4a68d563-bccc-47ed-818a-97c509777cc4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:46.122556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4a68d563-bccc-47ed-818a-97c509777cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:46.143992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:46.145026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.145309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.145574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] PATH_INFO: `/v3/groups` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.146215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:46.147679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:46.159636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:46.191201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 156/324] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:46.192638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d8899-0617-433d-9656-0e8c09ed4e14 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.192925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d8899-0617-433d-9656-0e8c09ed4e14 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.193198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d8899-0617-433d-9656-0e8c09ed4e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.211116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fd4d8899-0617-433d-9656-0e8c09ed4e14 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:46.212342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fd4d8899-0617-433d-9656-0e8c09ed4e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:46.245208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 169/325] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Sep 26 12:12:46 2022] POST /identity/v3/groups => generated 226 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:12:46.286081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 157/326] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:46.475176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:46.557199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d8899-0617-433d-9656-0e8c09ed4e14 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:46.558190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:46.589917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf16c8-6ff1-4836-beee-6f0fd4e72556 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:46.633344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:46.633994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.634273 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.634548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.649105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:46.654677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:46.655754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:46.656555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 170/327] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:46.664181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:46.699032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d8899-0617-433d-9656-0e8c09ed4e14 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:46.702097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:46.749047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:46.749611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.749890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.750555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.761803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:46.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:46.768202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:46.768986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 158/328] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:46.774879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:46.801952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e117b1-bc29-4ccf-a61d-695779720f70 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:46.846331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:46.847896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.847896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.847896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.848126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:46.848303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:46.849679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:46.855160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:46.864094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 171/329] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:46.875558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:46.918901 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1a54a-aa18-4965-a92d-c0d2a5a3896c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:46.971201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:46.972087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:46.972770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:46.973188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:46.974260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:46.974749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:46.980189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:46.990756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 159/330] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:46.997684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:47.025271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcd318-99b7-4a67-9dee-3e1848906daa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:47.031880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:47.072722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:47.073528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:47.073907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:47.074276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] PATH_INFO: `/v3/users/3da49d61a1614811ba100725ee8afbfd` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:47.075758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] RBAC: Authorizing `identity:get_user(user_id=3da49d61a1614811ba100725ee8afbfd)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:47.078520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:47.085704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 172/331] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:46 2022] GET /identity/v3/users/3da49d61a1614811ba100725ee8afbfd => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:47.089266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:47.142183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fc311-b810-43cb-b385-4165fa95ed4e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:47.170322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:47.191155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:47.192180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:47.192860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:47.193342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] PATH_INFO: `/v3/users/6ed3577ac55145bd912f0e65b234f8a2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:47.195562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] RBAC: Authorizing `identity:get_user(user_id=6ed3577ac55145bd912f0e65b234f8a2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:47.197543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:47.201465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 160/332] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:46 2022] GET /identity/v3/users/6ed3577ac55145bd912f0e65b234f8a2 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:47.207663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:47.218076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd61ff-84f4-4efe-aaeb-d6cf42439a11 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:47.259214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf73573-0653-4767-9d1a-3b0d5cbc0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:47.259996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73573-0653-4767-9d1a-3b0d5cbc0491 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:47.260333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73573-0653-4767-9d1a-3b0d5cbc0491 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:47.260678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf73573-0653-4767-9d1a-3b0d5cbc0491 None admin] PATH_INFO: `/v3/system/users/3da49d61a1614811ba100725ee8afbfd/roles/c56909e1368744ca8582c45b1328fb2b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:47.262466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73573-0653-4767-9d1a-3b0d5cbc0491 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3da49d61a1614811ba100725ee8afbfd, role_id=c56909e1368744ca8582c45b1328fb2b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:47.264555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf73573-0653-4767-9d1a-3b0d5cbc0491 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:47.326292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:47.337183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e3c4-d97d-401d-ac71-8670a1debb01 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:47.343959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 173/333] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Sep 26 12:12:47 2022] PUT /identity/v3/system/users/3da49d61a1614811ba100725ee8afbfd/roles/c56909e1368744ca8582c45b1328fb2b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:47.384670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500051d-1d3b-4bfd-b3a7-3a9b2c1c0d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:47.385688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500051d-1d3b-4bfd-b3a7-3a9b2c1c0d30 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:47.386151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500051d-1d3b-4bfd-b3a7-3a9b2c1c0d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:47.386602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500051d-1d3b-4bfd-b3a7-3a9b2c1c0d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:47.387935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500051d-1d3b-4bfd-b3a7-3a9b2c1c0d30 None admin] RBAC: Adding query filter params (role.id=de5d8b924ce74b7d81747e8e0d91c075, user.id=6ed3577ac55145bd912f0e65b234f8a2, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:47.388593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500051d-1d3b-4bfd-b3a7-3a9b2c1c0d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:47.390896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500051d-1d3b-4bfd-b3a7-3a9b2c1c0d30 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:47.410393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 161/334] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Sep 26 12:12:47 2022] GET /identity/v3/role_assignments?user.id=6ed3577ac55145bd912f0e65b234f8a2&scope.system=all&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:49.097507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa825c58-2a7b-439d-96df-1688e16a90b7 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:49.098030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa825c58-2a7b-439d-96df-1688e16a90b7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:49.098244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa825c58-2a7b-439d-96df-1688e16a90b7 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:49.099609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 174/335] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:49.105158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81d5cf-6f57-4417-b311-f342952838f4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:49.105601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81d5cf-6f57-4417-b311-f342952838f4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:49.105697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81d5cf-6f57-4417-b311-f342952838f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:49.129436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cb81d5cf-6f57-4417-b311-f342952838f4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:49.130644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb81d5cf-6f57-4417-b311-f342952838f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:49.221106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 162/336] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:49.530860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa825c58-2a7b-439d-96df-1688e16a90b7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:49.657156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa825c58-2a7b-439d-96df-1688e16a90b7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:49.695926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:49.702014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86e130-2710-4dbd-a432-9a943a95633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:49.702660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e130-2710-4dbd-a432-9a943a95633a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:49.702933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e130-2710-4dbd-a432-9a943a95633a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:49.703201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86e130-2710-4dbd-a432-9a943a95633a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:49.724285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86e130-2710-4dbd-a432-9a943a95633a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7c86e130-2710-4dbd-a432-9a943a95633a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:49.729179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:49.730122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:49.730896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 175/337] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:49.736259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81d5cf-6f57-4417-b311-f342952838f4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:49.763051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61232f8-ae80-4645-95b6-46b29bae38cb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:49.764040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61232f8-ae80-4645-95b6-46b29bae38cb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:49.764313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61232f8-ae80-4645-95b6-46b29bae38cb None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:49.765955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 176/338] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:49.771557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd173042-f355-439c-82fa-8544bcc6e5ce None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:49.771837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd173042-f355-439c-82fa-8544bcc6e5ce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:49.772110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd173042-f355-439c-82fa-8544bcc6e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:49.800991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cd173042-f355-439c-82fa-8544bcc6e5ce None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:49.802124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cd173042-f355-439c-82fa-8544bcc6e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:49.903717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:49.930191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81d5cf-6f57-4417-b311-f342952838f4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:49.970127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 177/339] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:49.988827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f536f-29da-46b6-91e3-ead0e36341b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:49.989443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f536f-29da-46b6-91e3-ead0e36341b4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:49.989723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f536f-29da-46b6-91e3-ead0e36341b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:49.990000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f536f-29da-46b6-91e3-ead0e36341b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:49.990670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f536f-29da-46b6-91e3-ead0e36341b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:49.990973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f536f-29da-46b6-91e3-ead0e36341b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:49.996664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f536f-29da-46b6-91e3-ead0e36341b4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:50.005683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 163/340] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:50.011764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd173042-f355-439c-82fa-8544bcc6e5ce None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:50.147176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd173042-f355-439c-82fa-8544bcc6e5ce None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:50.172411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:50.187736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:50.188353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.188629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.188899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.261100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:50.262875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:50.349724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9f3-59ba-42dd-9c82-2693e3844063 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.350231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9f3-59ba-42dd-9c82-2693e3844063 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.350231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc9f3-59ba-42dd-9c82-2693e3844063 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.351525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 164/341] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:50.357156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9d55e-76b8-4a44-ae25-e9415c1fb9e7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.357574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9d55e-76b8-4a44-ae25-e9415c1fb9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.357888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9d55e-76b8-4a44-ae25-e9415c1fb9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.367875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 178/342] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:50.373884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:50.396824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:50.400696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-08e9d55e-76b8-4a44-ae25-e9415c1fb9e7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:50.401969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-08e9d55e-76b8-4a44-ae25-e9415c1fb9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:50.488923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce870bc-df5a-4018-a308-5cccfa8979c5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:50.526533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:50.527166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.527471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.527746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.528947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:50.530436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:50.532249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 179/343] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:50 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:50.533012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:50.597885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 165/344] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:50.598786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9d55e-76b8-4a44-ae25-e9415c1fb9e7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:50.696133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:50.713597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd35cf-6c30-4a98-95a2-c138f2853491 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:50.741500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:50.796139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82644da1-9991-4c40-85a2-b361ba37a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:50.797161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82644da1-9991-4c40-85a2-b361ba37a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.797660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82644da1-9991-4c40-85a2-b361ba37a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.798139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82644da1-9991-4c40-85a2-b361ba37a2f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.799219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9d55e-76b8-4a44-ae25-e9415c1fb9e7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:50.813709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82644da1-9991-4c40-85a2-b361ba37a2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-82644da1-9991-4c40-85a2-b361ba37a2f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:50.827983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:50.829006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:50.829804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:50.832878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 180/345] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:50.834347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ccbe-28a7-4fa1-a919-0e9d8dd9cdbf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.834822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ccbe-28a7-4fa1-a919-0e9d8dd9cdbf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.835283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ccbe-28a7-4fa1-a919-0e9d8dd9cdbf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.837108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 181/346] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:50.843121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6048f-4de5-4278-a4ca-7f13f7ec4140 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.843760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6048f-4de5-4278-a4ca-7f13f7ec4140 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.844319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6048f-4de5-4278-a4ca-7f13f7ec4140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.845942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:50.846593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:50.846868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:50.847139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:50.854256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:50.856016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:50.859046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 166/347] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:50 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:50.860270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:50.880391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2fd6048f-4de5-4278-a4ca-7f13f7ec4140 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:50.881922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2fd6048f-4de5-4278-a4ca-7f13f7ec4140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:50.978285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5430b6a-3c16-4e30-bc5d-31c4412e245b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:50.993150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 182/348] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:50.994384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6048f-4de5-4278-a4ca-7f13f7ec4140 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:51.031846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:51.032495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.032846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.033130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.033914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:51.034221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:51.035749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:51.038588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:51.053949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 167/349] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:51.059783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:51.131082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:51.158964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6048f-4de5-4278-a4ca-7f13f7ec4140 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:51.211086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51f24e-f52c-4def-b513-f674f5b95fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:51.212956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f24e-f52c-4def-b513-f674f5b95fbd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.213241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f24e-f52c-4def-b513-f674f5b95fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.213518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f24e-f52c-4def-b513-f674f5b95fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.214271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51f24e-f52c-4def-b513-f674f5b95fbd None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=51f8a8823cda45c1925f2cae6377e284) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:51.214587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51f24e-f52c-4def-b513-f674f5b95fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:51.216176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51f24e-f52c-4def-b513-f674f5b95fbd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:51.216892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2580b-384b-460d-bffb-ca6ad05b2733 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:51.223730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 183/350] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:12:50 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:51.225383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801132a-8f4c-4a7b-b0a7-f7692488e650 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.225719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801132a-8f4c-4a7b-b0a7-f7692488e650 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.225995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801132a-8f4c-4a7b-b0a7-f7692488e650 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.229270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 184/351] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:51.230246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801132a-8f4c-4a7b-b0a7-f7692488e650 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:51.283088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:51.284411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.284892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.285472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.371173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801132a-8f4c-4a7b-b0a7-f7692488e650 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:51.379526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:51.386543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:51.389675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:51.410752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ca386-6078-41c9-a45a-2a92fbae034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:51.411594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca386-6078-41c9-a45a-2a92fbae034f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.411974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca386-6078-41c9-a45a-2a92fbae034f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.412347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ca386-6078-41c9-a45a-2a92fbae034f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.425450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ca386-6078-41c9-a45a-2a92fbae034f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5b2ca386-6078-41c9-a45a-2a92fbae034f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:51.430744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:51.431784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:51.432573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:51.434663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 185/352] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:51.436194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae2ef-1616-4af2-9af1-3192a3ac87cf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.436582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae2ef-1616-4af2-9af1-3192a3ac87cf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.436952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fae2ef-1616-4af2-9af1-3192a3ac87cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.461878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-97fae2ef-1616-4af2-9af1-3192a3ac87cf None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:51.464069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-97fae2ef-1616-4af2-9af1-3192a3ac87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:51.480097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:51.535711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 168/353] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:51.536842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:51.578980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 186/354] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:51.580097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fae2ef-1616-4af2-9af1-3192a3ac87cf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:51.681748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:51.690220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66aeb05-5bdd-4576-a855-aaf66a074454 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:51.698927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fae2ef-1616-4af2-9af1-3192a3ac87cf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:51.738688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:51.744617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:51.745373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.745751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.746117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.753872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:51.754722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:51.755168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:51.755611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:51.756422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:51.756866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:51.758395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:51.759850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:51.765855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:51.766793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:51.767643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 187/355] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:51.768286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:51.777546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 169/356] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:51.783671 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:51.969412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d103d-2c25-4f0a-926e-fa5ee3c3bbe0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:51.983028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ee3bb-f050-4196-bc5b-b6e02e75f4b9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:52.014927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.015553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.017725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.018026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.020051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:52.021904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:52.024689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 188/357] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:51 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:52.025439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.033114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91975ce-18da-4d2d-96ef-d8486aa259c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.033732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91975ce-18da-4d2d-96ef-d8486aa259c5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.034013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91975ce-18da-4d2d-96ef-d8486aa259c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.034283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91975ce-18da-4d2d-96ef-d8486aa259c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.034959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91975ce-18da-4d2d-96ef-d8486aa259c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:52.035260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91975ce-18da-4d2d-96ef-d8486aa259c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:52.036939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91975ce-18da-4d2d-96ef-d8486aa259c5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:52.049523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 170/358] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:52.050827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a9ef3-5881-43a1-9b23-c50133f16393 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.051116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a9ef3-5881-43a1-9b23-c50133f16393 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.051467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a9ef3-5881-43a1-9b23-c50133f16393 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.052842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 171/359] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:52.053389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a9ef3-5881-43a1-9b23-c50133f16393 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.087622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:52.127898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:52.187085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef227e8-a9f9-40a4-b9f8-9bcf3a4c5d0f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:52.210289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a9ef3-5881-43a1-9b23-c50133f16393 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:52.225818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dd495-a701-4ca3-b8a1-cdda8085f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.226435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dd495-a701-4ca3-b8a1-cdda8085f303 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.226719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dd495-a701-4ca3-b8a1-cdda8085f303 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.227252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dd495-a701-4ca3-b8a1-cdda8085f303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.255637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.256398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.256678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.256952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.258720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:52.260279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:52.262509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 172/360] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:52.263480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.311778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dd495-a701-4ca3-b8a1-cdda8085f303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:52.313524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dd495-a701-4ca3-b8a1-cdda8085f303 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:52.390583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:52.394705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:52.403788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22568931-d3c8-40d8-beb6-149736b10f99 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:52.453341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.453957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.454232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.454500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.457114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 189/361] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:52.459365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5ce4-2970-43d8-9721-567cd4e686f9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.459671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5ce4-2970-43d8-9721-567cd4e686f9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.460194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5ce4-2970-43d8-9721-567cd4e686f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.483295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b2cb5ce4-2970-43d8-9721-567cd4e686f9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:52.484598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b2cb5ce4-2970-43d8-9721-567cd4e686f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:52.553338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:52.555877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:52.580419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 190/362] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:52.581592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb5ce4-2970-43d8-9721-567cd4e686f9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.674256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:52.680753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:52.687683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 173/363] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:52.688841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.698474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb5ce4-2970-43d8-9721-567cd4e686f9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:52.735731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.736363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.736639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.736908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.748342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:52.753324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:52.754195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:52.754999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 191/364] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:52.755708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.811486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a64b9-2950-4882-8668-4abc563708f8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:52.861134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.862160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.862654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.863072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.864163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=51f8a8823cda45c1925f2cae6377e284) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:52.864699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:52.866508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:52.872302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03aaa6-e545-4bd3-9df7-61f7dd0f6945 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:52.877699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 174/365] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:52.878750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.927080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:52.927758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:52.928033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:52.928302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:52.929487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:52.930967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:52.932707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 192/366] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:52.933489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:52.954450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:52.962155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:53.019499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d824fb-c182-4a2e-859f-cd37247441cc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.046565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062b40b-e48a-48a5-8e41-7210ed8cc65e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.063106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.066500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.066500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.066500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.067679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.069414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.075377 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 175/367] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.075377 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.110620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.111297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.111574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.111911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.112648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:53.112963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.114965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.128063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 193/368] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.128915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.221970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf58eb-d079-40c1-bc6a-3fc6525c90b7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.242647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:53.258444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:53.271560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7b9d2-dc36-428f-970a-a2b414c64c31 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.277651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.278400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.279259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.279575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.294254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:53.300312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:53.301216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:53.302019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 176/369] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:53.303302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.328169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.328811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.329105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.329364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.330680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.332472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.334080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 194/370] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.335387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.456262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fb9ae-7bc4-4999-a858-ffb52c354cc5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.469737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5b8f5-4b31-435a-b725-5bde57a823b8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.500880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.504138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.504676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.505270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.506825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.508446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.510447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 177/371] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.511129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.511456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.516846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.516846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.516846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] PATH_INFO: `/v3/users/3da49d61a1614811ba100725ee8afbfd` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.519828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] RBAC: Authorizing `identity:get_user(user_id=3da49d61a1614811ba100725ee8afbfd)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.521275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.523013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 195/372] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/users/3da49d61a1614811ba100725ee8afbfd => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.523673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.545272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:53.596258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:53.661799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f7afe-6842-4141-ab73-70321593f547 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.675680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a92e07-0886-4f89-972e-0b9d475f129b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.699135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.699783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.700067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.700401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.701699 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:53.702111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.703737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.710665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 196/373] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.711485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.722235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.722866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.723142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.723438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.724129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:53.724436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.726014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.739234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 178/374] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.740195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.860612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:53.883226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d36fd62-a2a3-4813-b8c0-747bb19df193 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.934152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:53.935531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:53.936000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:53.936860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:53.937633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:53.937976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:53.939518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:53.946169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 197/375] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:53.946916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:53.955314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46caa62-464d-4821-b7c6-7ac91bc3caf5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:53.987445 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:54.047470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b23c8-b1d0-411d-92ea-90a8740f644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:54.048092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b23c8-b1d0-411d-92ea-90a8740f644b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:54.048363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b23c8-b1d0-411d-92ea-90a8740f644b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:54.048627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b23c8-b1d0-411d-92ea-90a8740f644b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:54.049367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b23c8-b1d0-411d-92ea-90a8740f644b None admin] RBAC: Adding query filter params (role.id=c56909e1368744ca8582c45b1328fb2b, user.id=3da49d61a1614811ba100725ee8afbfd, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:54.049668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b23c8-b1d0-411d-92ea-90a8740f644b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:54.051148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b23c8-b1d0-411d-92ea-90a8740f644b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:54.080841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 179/376] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/role_assignments?user.id=3da49d61a1614811ba100725ee8afbfd&scope.system=all&role.id=c56909e1368744ca8582c45b1328fb2b => generated 510 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:54.083939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f460c8e-5641-42d4-bdc8-4f6071e25ff8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:54.083939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f460c8e-5641-42d4-bdc8-4f6071e25ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:54.084284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f460c8e-5641-42d4-bdc8-4f6071e25ff8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:54.092066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 180/377] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:54.094098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b29a-1824-4fac-b0fd-2604d0cec7c6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:54.094381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b29a-1824-4fac-b0fd-2604d0cec7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:54.094654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92b29a-1824-4fac-b0fd-2604d0cec7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:54.133353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3c92b29a-1824-4fac-b0fd-2604d0cec7c6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:54.134613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3c92b29a-1824-4fac-b0fd-2604d0cec7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:54.221743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18f828-478a-42e3-9d02-faaefcb2a99d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:54.261744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 181/378] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:54.310628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:54.310628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:54.310628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:54.310628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:54.334172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:54.398042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:54.399927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:54.513718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 198/379] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:12:54.519566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b29a-1824-4fac-b0fd-2604d0cec7c6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:54.642170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:54.644969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92b29a-1824-4fac-b0fd-2604d0cec7c6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:54.682396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:54.683041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:54.683319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:54.683615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] PATH_INFO: `/v3/projects/72cdb02c523548e3a44964d7bf629c5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:54.684735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] RBAC: Authorizing `identity:get_project(project_id=72cdb02c523548e3a44964d7bf629c5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:54.687038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:54.689099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 182/380] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:54 2022] GET /identity/v3/projects/72cdb02c523548e3a44964d7bf629c5b => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:54.691065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:54.695650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:54.778457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:54.892895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e12e4e-568d-4685-b86b-905cf1da2b02 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:54.907307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b3396-7491-4e47-90e4-56bcc5e6fa6d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:54.969743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:54.970391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:54.970670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:54.970940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:54.986841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:54.987520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:54.987798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:54.988068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] PATH_INFO: `/v3/groups/e4341f450a874335b0f816ffdf6d9a3f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:54.989560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:54.994561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:54.995513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:54.996300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:55.001300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 199/381] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:55.001890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] RBAC: Authorizing `identity:get_group(group_id=e4341f450a874335b0f816ffdf6d9a3f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:55.003408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:55.005437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 183/382] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:54 2022] GET /identity/v3/groups/e4341f450a874335b0f816ffdf6d9a3f => generated 229 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:55.006398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:55.011405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:55.075921 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:55.190572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9924ed-fdc9-4153-a759-4fa8f979b0d6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:55.229888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:55.230498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:55.230781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:55.231051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:55.232372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] RBAC: Adding query filter params (group.id=e4341f450a874335b0f816ffdf6d9a3f, role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=72cdb02c523548e3a44964d7bf629c5b) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:55.232684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:55.234124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:55.242841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 184/383] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:12:55 2022] GET /identity/v3/role_assignments?group.id=e4341f450a874335b0f816ffdf6d9a3f&scope.project.id=72cdb02c523548e3a44964d7bf629c5b&role.id=6e8e99de087147e09c760c84a9b30604 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:55.261712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1db440-7699-4bae-b88f-860acb8b5208 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:55.268303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:55.336285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:55.336918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:55.337211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:55.337397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:55.338034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:55.338334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:55.339775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:55.351607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 200/384] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:55.357209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:55.520310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:55.529589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9b5d9-e01f-49d1-a2f0-9f7baa074ea3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:55.593939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:55.594508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:55.595078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:55.595364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:55.600012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:55.601461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:55.603380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 185/385] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:55 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:55.609586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:55.747141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc1302-2839-4054-a287-7c9f49e261f7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:55.790790 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d36a6-95f4-47d3-83cb-ed5153eb4761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:55.791459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d36a6-95f4-47d3-83cb-ed5153eb4761 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:55.791744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d36a6-95f4-47d3-83cb-ed5153eb4761 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:55.792019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d36a6-95f4-47d3-83cb-ed5153eb4761 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:55.796102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d36a6-95f4-47d3-83cb-ed5153eb4761 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:55.797568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d36a6-95f4-47d3-83cb-ed5153eb4761 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:55.799595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 201/386] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:55 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:55.805082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:55.890109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98b13-b4b1-4357-8fe2-245835d2c368 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:55.890460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98b13-b4b1-4357-8fe2-245835d2c368 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:55.890646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98b13-b4b1-4357-8fe2-245835d2c368 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:55.892959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 202/387] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:55.911495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadde9a-4d80-41ff-9bc6-4c3f9d46cee9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:55.911833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadde9a-4d80-41ff-9bc6-4c3f9d46cee9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:55.912012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eadde9a-4d80-41ff-9bc6-4c3f9d46cee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:55.944442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7eadde9a-4d80-41ff-9bc6-4c3f9d46cee9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:55.945657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7eadde9a-4d80-41ff-9bc6-4c3f9d46cee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:55.985507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebe385-9efa-439a-b042-1d7408193478 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:56.006336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:56.031410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:56.032881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:56.033383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:56.033922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:56.036459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f8a8823cda45c1925f2cae6377e284, group_id=b13f294323ec4d4c8bdaa0c2e7f92e22, role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:56.038675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:56.079335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 203/388] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:56.130988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 186/389] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Sep 26 12:12:55 2022] PUT /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:56.386602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadde9a-4d80-41ff-9bc6-4c3f9d46cee9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:56.509760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eadde9a-4d80-41ff-9bc6-4c3f9d46cee9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:56.557629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fad530-b9ec-48bc-b1e9-48fd8d30fd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:56.558293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fad530-b9ec-48bc-b1e9-48fd8d30fd9f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:56.558572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fad530-b9ec-48bc-b1e9-48fd8d30fd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:56.558843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fad530-b9ec-48bc-b1e9-48fd8d30fd9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:56.574744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fad530-b9ec-48bc-b1e9-48fd8d30fd9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-90fad530-b9ec-48bc-b1e9-48fd8d30fd9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:56.580459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:56.581381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:56.582740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 204/390] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:56.587520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:56.636757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:56.672218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff5bcc-3cfe-4e67-9bbc-4fb726adde99 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:56.672588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff5bcc-3cfe-4e67-9bbc-4fb726adde99 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:56.672798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff5bcc-3cfe-4e67-9bbc-4fb726adde99 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:56.674675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 205/391] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:56.682658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08e96-5d6f-4c68-827e-e3bf0450add3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:56.683555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08e96-5d6f-4c68-827e-e3bf0450add3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:56.695158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08e96-5d6f-4c68-827e-e3bf0450add3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:56.709244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ffc08e96-5d6f-4c68-827e-e3bf0450add3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:56.711393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ffc08e96-5d6f-4c68-827e-e3bf0450add3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:56.739654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:56.757054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4dba4-6c9f-442b-8e8f-0f86e8e209a0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:56.801753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:56.802375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:56.802655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:56.802930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:56.803627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:56.803935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:56.805328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:56.828849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 187/392] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:56.835434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:56.845501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 206/393] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:56.956683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:56.976895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b2bc-f54a-418e-806a-c7027b96408e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:57.026016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b999c2-7209-4601-8071-5c98758d0768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:57.026670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b999c2-7209-4601-8071-5c98758d0768 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.026943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b999c2-7209-4601-8071-5c98758d0768 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.027210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b999c2-7209-4601-8071-5c98758d0768 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.032036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b999c2-7209-4601-8071-5c98758d0768 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:57.033637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b999c2-7209-4601-8071-5c98758d0768 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:57.035586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 188/394] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:56 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:57.041491 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08e96-5d6f-4c68-827e-e3bf0450add3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.099835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696ffc-108a-41eb-95e3-72d3c9de1596 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.100141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696ffc-108a-41eb-95e3-72d3c9de1596 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.100515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696ffc-108a-41eb-95e3-72d3c9de1596 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.102295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 189/395] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:12:57.109315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a326cd6-d5d7-4eec-96cb-aa24825f2e00 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.109573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a326cd6-d5d7-4eec-96cb-aa24825f2e00 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.110212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a326cd6-d5d7-4eec-96cb-aa24825f2e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.132281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8a326cd6-d5d7-4eec-96cb-aa24825f2e00 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:57.133608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a326cd6-d5d7-4eec-96cb-aa24825f2e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:57.200748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08e96-5d6f-4c68-827e-e3bf0450add3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:57.240009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:57.240574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.240853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.241130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.242925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:57.244709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:57.247173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 207/396] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:57 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:57.252115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.270453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 190/397] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:57.271556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a326cd6-d5d7-4eec-96cb-aa24825f2e00 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.295205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:57.421465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13008b0e-50b3-4896-b7d7-921192450710 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:57.459233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:57.459913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.460221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.460578 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.469343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:57.472723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:57.477679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:57.478769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:57.479672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 208/398] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:57.486272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.534270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a326cd6-d5d7-4eec-96cb-aa24825f2e00 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:57.590146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:57.590912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.591132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.591500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.592115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:57.593661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] RBAC: Authorizing `identity:create_grant(project_id=51f8a8823cda45c1925f2cae6377e284, group_id=b13f294323ec4d4c8bdaa0c2e7f92e22, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:57.595119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:57.597768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81017206-1165-4446-a3b0-3f5bb0d2d18e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:57.634780 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:57.635503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.635784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.636055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.637128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:57.637431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:57.639376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:57.647972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 209/399] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:12:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:57.648807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.659266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 191/400] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Sep 26 12:12:57 2022] PUT /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:57.668404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.773479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edd54b-79cf-4662-a8a1-1431c9511109 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:57.816106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:57.816857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.817300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.817639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.830424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:57.836265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:57.837124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:57.838012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:57.839400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 210/401] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:57.844163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.848346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:57.853949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc106d0-d62b-4148-92c2-44ce65053cfe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:57.922011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:57.922673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:57.922953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:57.923226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:57.924510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:57.925994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:57.927677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 192/402] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:57 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:57.937158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:57.967458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:57.970086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faeedee-505b-4c44-ab82-f011bd80e52c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:58.011469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:58.012335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.012612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.012882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.014606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:58.014910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:58.016359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:58.026127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 211/403] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:58.033762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:58.114806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e701-ac63-48ef-8c94-43b89837eb06 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:58.141954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:58.158437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32d057-2ced-47de-ae6a-a8e014e76fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:58.159143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d057-2ced-47de-ae6a-a8e014e76fad None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.159763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d057-2ced-47de-ae6a-a8e014e76fad None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.159763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d057-2ced-47de-ae6a-a8e014e76fad None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.161622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32d057-2ced-47de-ae6a-a8e014e76fad None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:58.163225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32d057-2ced-47de-ae6a-a8e014e76fad None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:58.164980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 193/404] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:57 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:58.169847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a125cc-3df0-4bc2-aeb6-3b7a47a5c3cf None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.169847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a125cc-3df0-4bc2-aeb6-3b7a47a5c3cf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.169847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a125cc-3df0-4bc2-aeb6-3b7a47a5c3cf None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.169847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 194/405] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:58.176904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073a53-0309-4952-9840-493e5b147206 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.177183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073a53-0309-4952-9840-493e5b147206 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.177456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073a53-0309-4952-9840-493e5b147206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.197250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc8565-16eb-4e20-b5f0-ea376d2ae82b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:58.199511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-03073a53-0309-4952-9840-493e5b147206 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:58.201919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-03073a53-0309-4952-9840-493e5b147206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:58.234416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:58.235484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.235988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.236568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.237920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:58.239627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:58.241668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 212/406] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:58 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:58.242514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:58.294131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 195/407] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:12:58.296538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073a53-0309-4952-9840-493e5b147206 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:58.312951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:58.399756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f51f92-0b49-4ff0-83c4-4315da37b409 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:58.472550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:58.473363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.473528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.473767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.477874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1dacb4fa7467990f4bd77bf2124e5, group_id=b13f294323ec4d4c8bdaa0c2e7f92e22, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:58.479418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:58.482566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:58.492541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073a53-0309-4952-9840-493e5b147206 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:58.531996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:58.532712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.532979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.533299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.534449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:58.536091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:58.538103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 196/408] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:58 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:58.543606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:58.563714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 213/409] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Sep 26 12:12:58 2022] PUT /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:58.635945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:58.682061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:58.732051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc981ad3-e26a-4d67-a46b-d6d8089bb75a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:58.792606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec328b04-1139-4c9a-b444-97878c7aee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:58.793524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328b04-1139-4c9a-b444-97878c7aee4a None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.793952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328b04-1139-4c9a-b444-97878c7aee4a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.795038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec328b04-1139-4c9a-b444-97878c7aee4a None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.798826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328b04-1139-4c9a-b444-97878c7aee4a None admin] RBAC: Authorizing `identity:create_grant(project_id=b6f1dacb4fa7467990f4bd77bf2124e5, group_id=b13f294323ec4d4c8bdaa0c2e7f92e22, role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:58.800587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec328b04-1139-4c9a-b444-97878c7aee4a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:58.814975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7bffd-9751-4203-8069-536e1a5bb302 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:58.853110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aeb69-59c8-4dd9-bd32-37b6a93751b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:58.853768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aeb69-59c8-4dd9-bd32-37b6a93751b6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.854083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aeb69-59c8-4dd9-bd32-37b6a93751b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.854358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aeb69-59c8-4dd9-bd32-37b6a93751b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.866228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aeb69-59c8-4dd9-bd32-37b6a93751b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-692aeb69-59c8-4dd9-bd32-37b6a93751b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:58.871874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:58.872774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:12:58.873584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 214/410] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:58.874791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3e62-0e74-4018-981b-5266725dd315 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.880769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3e62-0e74-4018-981b-5266725dd315 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.880769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad3e62-0e74-4018-981b-5266725dd315 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.880769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 215/411] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:12:58.881539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad3e62-0e74-4018-981b-5266725dd315 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:58.929658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 197/412] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Sep 26 12:12:58 2022] PUT /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5/groups/b13f294323ec4d4c8bdaa0c2e7f92e22/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:58.937272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44403-d56c-43aa-b7d9-cfdd06b3b224 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:58.937511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44403-d56c-43aa-b7d9-cfdd06b3b224 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:58.938440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b44403-d56c-43aa-b7d9-cfdd06b3b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:58.971497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:58.976379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d0b44403-d56c-43aa-b7d9-cfdd06b3b224 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:12:58.977670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d0b44403-d56c-43aa-b7d9-cfdd06b3b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:12:59.070549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad3e62-0e74-4018-981b-5266725dd315 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:59.112448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:59.113583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:59.114065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:59.114567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:59.115484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:12:59.115994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:59.118035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:59.133753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 216/413] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:12:59.145373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:59.155844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 198/414] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:12:59.253418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07462fe0-b47c-4576-8d37-9dcab74584e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:59.271169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:59.290057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:59.290738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:59.291079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:59.291369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] PATH_INFO: `/v3/groups/e4341f450a874335b0f816ffdf6d9a3f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:59.292516 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] RBAC: Authorizing `identity:get_group(group_id=e4341f450a874335b0f816ffdf6d9a3f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:59.293946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:59.295726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 217/415] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:12:59 2022] GET /identity/v3/groups/e4341f450a874335b0f816ffdf6d9a3f => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:59.301567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44403-d56c-43aa-b7d9-cfdd06b3b224 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:59.374282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:59.421499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b44403-d56c-43aa-b7d9-cfdd06b3b224 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:59.477010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:59.477664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:59.477941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:59.478211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] PATH_INFO: `/v3/projects/72cdb02c523548e3a44964d7bf629c5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:59.479405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] RBAC: Authorizing `identity:get_project(project_id=72cdb02c523548e3a44964d7bf629c5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:59.480857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:59.483549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 199/416] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:12:59 2022] GET /identity/v3/projects/72cdb02c523548e3a44964d7bf629c5b => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:12:59.489466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:59.542070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:59.702892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aed88-6243-421b-95b2-3e64721fe10b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:59.719088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd9898-54b1-4515-8385-3909ef838c95 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:12:59.781143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:59.782595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:59.783413 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:59.784326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] PATH_INFO: `/v3/projects/72cdb02c523548e3a44964d7bf629c5b/groups/e4341f450a874335b0f816ffdf6d9a3f/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:59.787492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] RBAC: Authorizing `identity:create_grant(project_id=72cdb02c523548e3a44964d7bf629c5b, group_id=e4341f450a874335b0f816ffdf6d9a3f, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:12:59.789579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:12:59.790360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:12:59.791179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:12:59.791664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:12:59.792155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:12:59.798219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:12:59.809058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:12:59.815234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:12:59.816158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:12:59.816938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:12:59.819276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 200/417] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:12:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:12:59.831423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:12:59.884227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 218/418] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Sep 26 12:12:59 2022] PUT /identity/v3/projects/72cdb02c523548e3a44964d7bf629c5b/groups/e4341f450a874335b0f816ffdf6d9a3f/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:12:59.967162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a830-3dad-453d-a61a-3e37f13cac7d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:00.014961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:00.016309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:00.016597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:00.016872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:00.018048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:00.018502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:00.021209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:00.037152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 201/419] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:00.045350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:00.127483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:00.194957 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9faa-4163-4343-ae5c-e8369ec8e99c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:00.246923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f3dd7-638b-4158-b920-774dec1cfe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:00.247666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3dd7-638b-4158-b920-774dec1cfe77 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:00.248166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3dd7-638b-4158-b920-774dec1cfe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:00.248455 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f3dd7-638b-4158-b920-774dec1cfe77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:00.326189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3dd7-638b-4158-b920-774dec1cfe77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:00.327871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f3dd7-638b-4158-b920-774dec1cfe77 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:00.381457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:00.456683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 219/420] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:00.462205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:00.544021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:00.593317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fe468-e853-4d26-8a4d-c25981354f87 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:00.639325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d11af-83f0-4a0b-8a0a-029c3bbd5b16 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:00.639873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d11af-83f0-4a0b-8a0a-029c3bbd5b16 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:00.639873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d11af-83f0-4a0b-8a0a-029c3bbd5b16 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:00.641521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 220/421] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:00.648946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b2b-5bcc-4d9d-abf2-ef84cd8444b7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:00.649225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b2b-5bcc-4d9d-abf2-ef84cd8444b7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:00.649508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76b2b-5bcc-4d9d-abf2-ef84cd8444b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:00.653752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:00.654498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:00.654694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:00.654956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:00.656177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:00.657644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:00.663466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 202/422] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:13:00 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:00.665245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:00.692435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-08c76b2b-5bcc-4d9d-abf2-ef84cd8444b7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:00.693661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-08c76b2b-5bcc-4d9d-abf2-ef84cd8444b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:00.832928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77aa9e-7606-453d-b0f2-86236a921a19 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:00.834159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 221/423] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:00.876914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:00.889909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:00.890617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:00.890903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:00.891180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:00.892342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:00.893950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:00.896895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 203/424] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:13:00 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:00.902073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76b2b-5bcc-4d9d-abf2-ef84cd8444b7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:00.995818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:01.007981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76b2b-5bcc-4d9d-abf2-ef84cd8444b7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:01.058380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168eb2b-22a9-4ab1-bb34-67aa5f67de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:01.059479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eb2b-22a9-4ab1-bb34-67aa5f67de11 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.060659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eb2b-22a9-4ab1-bb34-67aa5f67de11 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.061159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168eb2b-22a9-4ab1-bb34-67aa5f67de11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.062158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168eb2b-22a9-4ab1-bb34-67aa5f67de11 None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=51f8a8823cda45c1925f2cae6377e284) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:01.062501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168eb2b-22a9-4ab1-bb34-67aa5f67de11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:01.064125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168eb2b-22a9-4ab1-bb34-67aa5f67de11 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:01.074688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 222/425] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:13:00 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:01.215826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:01.282062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9eb6-05b4-4394-8689-088f365126f7 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.282419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9eb6-05b4-4394-8689-088f365126f7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.282687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9eb6-05b4-4394-8689-088f365126f7 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.284753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 223/426] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:13:01.293521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd870e-f27b-4561-b467-f8b6b33bce78 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.293989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd870e-f27b-4561-b467-f8b6b33bce78 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.295236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd870e-f27b-4561-b467-f8b6b33bce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.326858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b4dd870e-f27b-4561-b467-f8b6b33bce78 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:01.329483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b4dd870e-f27b-4561-b467-f8b6b33bce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:01.384253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085130a-bd9a-4ac2-8e64-0e6bf45721e7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:01.434308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:01.435582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.435861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.436379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.455659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 224/427] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:01.459434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:01.463714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:01.464637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:01.465446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 204/428] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:01.471691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd870e-f27b-4561-b467-f8b6b33bce78 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:01.550563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:01.589985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd870e-f27b-4561-b467-f8b6b33bce78 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:01.633857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd96dd-b17e-42dd-af30-7799f826d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:01.634838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd96dd-b17e-42dd-af30-7799f826d205 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.635321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd96dd-b17e-42dd-af30-7799f826d205 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.635908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd96dd-b17e-42dd-af30-7799f826d205 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.637058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd96dd-b17e-42dd-af30-7799f826d205 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:01.637567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd96dd-b17e-42dd-af30-7799f826d205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:01.639307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd96dd-b17e-42dd-af30-7799f826d205 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:01.649331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 225/429] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:13:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:01.655482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:01.714599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:01.717535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc6809-2ab7-4aae-98e8-461c2554eebd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.717917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc6809-2ab7-4aae-98e8-461c2554eebd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.718271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc6809-2ab7-4aae-98e8-461c2554eebd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.719973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 226/430] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:13:01.728291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694421e-26fb-49ad-b66a-1906ae9b26da None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.728291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694421e-26fb-49ad-b66a-1906ae9b26da None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.728291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694421e-26fb-49ad-b66a-1906ae9b26da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.745503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7694421e-26fb-49ad-b66a-1906ae9b26da None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:01.746711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7694421e-26fb-49ad-b66a-1906ae9b26da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:01.771048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca1f3c-ccac-483a-9054-c87e7a8cdd32 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:01.809452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:01.810128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:01.810462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:01.810653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:01.836401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 227/431] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:13:01.840277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694421e-26fb-49ad-b66a-1906ae9b26da None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:01.907305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:01.909323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:01.916199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:01.968169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694421e-26fb-49ad-b66a-1906ae9b26da None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:01.975593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:02.009131 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.009695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.009975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.010249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.023042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:02.028281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:02.029800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:02.030583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 228/432] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:02.037833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.042074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 205/433] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:02.051150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.159888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a05854-3451-4470-8a6e-dca4ce817e65 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.168356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ddb9-aa3b-4338-820e-c6fb4ffa84f0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.194797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:02.199511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.200163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.200481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.200806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] PATH_INFO: `/v3/projects/51f8a8823cda45c1925f2cae6377e284` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.202026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] RBAC: Authorizing `identity:get_project(project_id=51f8a8823cda45c1925f2cae6377e284)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:02.203535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:02.205222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 206/434] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/projects/51f8a8823cda45c1925f2cae6377e284 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:02.206003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.215751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.217593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.218072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.218518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.219538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:02.220059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:02.221750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:02.238050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:02.238841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 229/435] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:02.239784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.332693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd65a0-b33c-48bd-83a1-aa07056809eb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.367879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f4401-6470-4133-9e21-401ff4b948ab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.373141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.374065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.374546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.374999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.387334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:02.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:02.394108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:02.394903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 207/436] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:02.395596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.415995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.416631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.417022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.417296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.418555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:02.420424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:02.422822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 230/437] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:02.423559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.480710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:02.499978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:02.520123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9518-de82-4660-b6f4-fe82b19d4768 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.541847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0094970-14f5-4ee4-81c1-f4c0beac40ef None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.557026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.557647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.557924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.558640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.581121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.581764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.582044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.582313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.583036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:02.583437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:02.584692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:02.594987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 231/438] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:02.595792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.643946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:02.645406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:02.719943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8dbe-b7f8-4415-9a3d-c4ddac4ddeca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.735974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:02.738276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:02.759695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 208/439] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:02.760647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.775428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.776367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.776811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.777093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.778004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=51f8a8823cda45c1925f2cae6377e284) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:02.778319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:02.780970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:02.797771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 232/440] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=51f8a8823cda45c1925f2cae6377e284&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:02.797771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:02.904308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737b596-010a-426f-886a-ca930bccd57e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.940607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362524-252a-480e-bbd9-92fe3487643a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:02.956334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff6717-2a9e-40bd-bdb8-4979fdcedd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.956975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff6717-2a9e-40bd-bdb8-4979fdcedd03 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.957247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff6717-2a9e-40bd-bdb8-4979fdcedd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.957720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff6717-2a9e-40bd-bdb8-4979fdcedd03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.988782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2188e-455b-4767-b58a-de840450c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:02.989438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2188e-455b-4767-b58a-de840450c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.989720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2188e-455b-4767-b58a-de840450c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.990014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2188e-455b-4767-b58a-de840450c2c1 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.991367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2188e-455b-4767-b58a-de840450c2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:02.992840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2188e-455b-4767-b58a-de840450c2c1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:02.994894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 233/441] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:02.996258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256601e-367c-4be3-a3f5-7a6293074bcb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:02.996580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256601e-367c-4be3-a3f5-7a6293074bcb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:02.996806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256601e-367c-4be3-a3f5-7a6293074bcb None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:02.998631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 234/442] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:03.005357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256601e-367c-4be3-a3f5-7a6293074bcb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:03.028648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:03.052263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff6717-2a9e-40bd-bdb8-4979fdcedd03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:03.053749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff6717-2a9e-40bd-bdb8-4979fdcedd03 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:03.072089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:03.144012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256601e-367c-4be3-a3f5-7a6293074bcb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:03.185294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 209/443] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:03.186200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d5fb5-a20a-49ed-ad17-c28428201770 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.186637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d5fb5-a20a-49ed-ad17-c28428201770 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.187011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d5fb5-a20a-49ed-ad17-c28428201770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.189874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:03.190781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.191063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.191332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.192548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:03.194025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:03.195656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 235/444] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:13:03 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:03.196581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:03.208624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2f5d5fb5-a20a-49ed-ad17-c28428201770 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:03.209887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2f5d5fb5-a20a-49ed-ad17-c28428201770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:03.304801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 210/445] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:03.304801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d5fb5-a20a-49ed-ad17-c28428201770 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:03.327293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:03.336882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3951bd0-8262-4fad-a2a5-6f3efc5f3037 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:03.358732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:03.396012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:03.396675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.396954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.397397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] PATH_INFO: `/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.401217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=b6f1dacb4fa7467990f4bd77bf2124e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:03.401217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:03.402697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 236/446] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:13:03 2022] GET /identity/v3/projects/b6f1dacb4fa7467990f4bd77bf2124e5 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:03.411522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:03.457828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d5fb5-a20a-49ed-ad17-c28428201770 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:03.498523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:03.499557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.500017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.500614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.501355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=de5d8b924ce74b7d81747e8e0d91c075, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:03.501807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:03.503214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:03.510482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 211/447] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:13:03 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=de5d8b924ce74b7d81747e8e0d91c075 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:03.555480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3e927-ad49-4faf-8815-55996e10e7e2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:03.593513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:03.598974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:03.599950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.600377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.600804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] PATH_INFO: `/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.602374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] RBAC: Authorizing `identity:get_group(group_id=b13f294323ec4d4c8bdaa0c2e7f92e22)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:03.603890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:03.607525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 237/448] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:13:03 2022] GET /identity/v3/groups/b13f294323ec4d4c8bdaa0c2e7f92e22 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:03.612512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:03.675328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:03.692701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:03.719214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b74c73-23f6-409c-87d5-4a448c374ba3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:03.745978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee5b6-bd0e-40bb-a8b0-451c9166f6e1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:03.772123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:03.772776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.773039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.773308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.786837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:03.791473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:03.792088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.792362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:03.792474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:03.793295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:03.794188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:03.795373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.795373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] RBAC: Adding query filter params (group.id=b13f294323ec4d4c8bdaa0c2e7f92e22, role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:03.795373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:03.795597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 212/449] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:03.795997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:03.801454 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:03.802647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 238/450] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:13:03 2022] GET /identity/v3/role_assignments?group.id=b13f294323ec4d4c8bdaa0c2e7f92e22&scope.project.id=b6f1dacb4fa7467990f4bd77bf2124e5&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:03.946145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c6e92-1e4e-4d3b-aaaa-bb13110517a5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:03.992088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:03.992976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:03.992976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:03.993210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:03.993783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:03.994079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:03.995526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:03.998772 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:04.009220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 213/451] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:04.016185 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:04.153180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb28c8-9cf6-4aab-9beb-e2e8d15e0fff None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:04.168855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:04.195688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:04.196694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:04.197167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:04.197708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:04.272211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:04.273598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:04.380316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 239/452] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:04.386131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:04.495437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfbe5f-9810-44b0-8395-5ba46e12c3a6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:04.531421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:04.531984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:04.532257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:04.532523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] PATH_INFO: `/v3/projects/72cdb02c523548e3a44964d7bf629c5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:04.533656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] RBAC: Authorizing `identity:get_project(project_id=72cdb02c523548e3a44964d7bf629c5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:04.535100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:04.536782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 214/453] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:13:04 2022] GET /identity/v3/projects/72cdb02c523548e3a44964d7bf629c5b => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:04.542540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:04.556814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:04.646007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cdcd0-b07a-431d-b0bf-27f384852011 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:04.680755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de5528-6d7f-432a-b705-789b8c60e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:04.681388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de5528-6d7f-432a-b705-789b8c60e71a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:04.681659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de5528-6d7f-432a-b705-789b8c60e71a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:04.681925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de5528-6d7f-432a-b705-789b8c60e71a None admin] PATH_INFO: `/v3/groups/e4341f450a874335b0f816ffdf6d9a3f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:04.683035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de5528-6d7f-432a-b705-789b8c60e71a None admin] RBAC: Authorizing `identity:get_group(group_id=e4341f450a874335b0f816ffdf6d9a3f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:04.684512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de5528-6d7f-432a-b705-789b8c60e71a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:04.686662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 240/454] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Sep 26 12:13:04 2022] GET /identity/v3/groups/e4341f450a874335b0f816ffdf6d9a3f => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:04.692677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:04.767996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:04.805282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a1cc-4855-4e21-8f96-5821e36e8564 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:04.842948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f238400-7eaa-4650-ad88-7594024f5a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:04.843582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f238400-7eaa-4650-ad88-7594024f5a07 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:04.843894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f238400-7eaa-4650-ad88-7594024f5a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:04.844163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f238400-7eaa-4650-ad88-7594024f5a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:04.844897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f238400-7eaa-4650-ad88-7594024f5a07 None admin] RBAC: Adding query filter params (group.id=e4341f450a874335b0f816ffdf6d9a3f, role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=72cdb02c523548e3a44964d7bf629c5b) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:04.845206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f238400-7eaa-4650-ad88-7594024f5a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:04.846635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f238400-7eaa-4650-ad88-7594024f5a07 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:04.852892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 215/455] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Sep 26 12:13:04 2022] GET /identity/v3/role_assignments?group.id=e4341f450a874335b0f816ffdf6d9a3f&scope.project.id=72cdb02c523548e3a44964d7bf629c5b&role.id=6e8e99de087147e09c760c84a9b30604 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:07.626453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea1c7-c6e4-4242-912e-13366943c5e2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:07.627497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea1c7-c6e4-4242-912e-13366943c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:07.627986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea1c7-c6e4-4242-912e-13366943c5e2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:07.629859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 241/456] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:07.635872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff25b08-d4eb-44f1-bcca-f9a68e3c8a3e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:07.636796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff25b08-d4eb-44f1-bcca-f9a68e3c8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:07.637534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff25b08-d4eb-44f1-bcca-f9a68e3c8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:07.668456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0ff25b08-d4eb-44f1-bcca-f9a68e3c8a3e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:07.670209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0ff25b08-d4eb-44f1-bcca-f9a68e3c8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:07.766193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 216/457] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:13:07.999119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d09553-735f-4755-a003-079f6b656f8c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:07.999795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d09553-735f-4755-a003-079f6b656f8c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.000294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d09553-735f-4755-a003-079f6b656f8c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.002166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 242/458] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:08.007704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1294b-612c-43b4-9b15-879a4e08e277 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:08.008255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1294b-612c-43b4-9b15-879a4e08e277 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.008722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1294b-612c-43b4-9b15-879a4e08e277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.036476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6af1294b-612c-43b4-9b15-879a4e08e277 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:08.038048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6af1294b-612c-43b4-9b15-879a4e08e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:08.122816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:08.137908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 217/459] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:08.211270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d09553-735f-4755-a003-079f6b656f8c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:08.336264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:08.361631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d09553-735f-4755-a003-079f6b656f8c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:08.392819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a89be-fe96-4648-b486-73cb9fadfa38 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:08.393453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a89be-fe96-4648-b486-73cb9fadfa38 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.393893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a89be-fe96-4648-b486-73cb9fadfa38 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.400021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 218/460] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:08.407497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705713b-6bf9-4884-86ec-866c2483a4af None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:08.407673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:08.408224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:08.408473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705713b-6bf9-4884-86ec-866c2483a4af None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.408572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.408751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.409218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705713b-6bf9-4884-86ec-866c2483a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.420015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:08.422159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:08.439970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:08.440930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:08.441750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:08.441750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:08.441750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:08.443968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 243/461] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:08.448390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b705713b-6bf9-4884-86ec-866c2483a4af None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:08.449507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:08.451698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b705713b-6bf9-4884-86ec-866c2483a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:08.563183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 219/462] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:08.563552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705713b-6bf9-4884-86ec-866c2483a4af None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:08.616443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651e9e7-84ee-43f0-b512-025ce6cf8eb2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:08.673070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:08.683306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:08.683947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:08.686572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.686572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.686572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:08.686572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:08.687136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:08.713956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 244/463] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:08.718960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:08.782930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705713b-6bf9-4884-86ec-866c2483a4af None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:08.835534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:08.880327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:08.881252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:08.881861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.883158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.914004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:08.915579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:08.925415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852e992-d3b2-429c-8b76-539c143c0e7b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:08.932211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:08.933176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:08.934052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:08.934052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:08.934052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:08.934052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 220/464] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:08.935405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:08.976415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:08.977400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:08.977884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:08.978356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:08.979268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:08.980984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:09.055378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 245/465] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:13:08 2022] POST /identity/v3/users => generated 246 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:09.055378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:09.074686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad27f4-acd7-4598-98b3-60fdf9d6707c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:09.127081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba769b-b936-4f1b-a27c-119bde24811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:09.127789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba769b-b936-4f1b-a27c-119bde24811c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.128068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba769b-b936-4f1b-a27c-119bde24811c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.128338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba769b-b936-4f1b-a27c-119bde24811c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.130174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:09.147299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba769b-b936-4f1b-a27c-119bde24811c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:09.148843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba769b-b936-4f1b-a27c-119bde24811c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-11ba769b-b936-4f1b-a27c-119bde24811c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:09.172565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:09.173844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:09.174660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:09.174660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:09.174660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:09.174660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 221/466] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:09.175794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee092f2-1681-4cec-9725-1008f61097fb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.175794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee092f2-1681-4cec-9725-1008f61097fb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.175794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee092f2-1681-4cec-9725-1008f61097fb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.184876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 222/467] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:09.184876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe785-158e-4eee-9607-81d6c0df3e7c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.184876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe785-158e-4eee-9607-81d6c0df3e7c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.184876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe785-158e-4eee-9607-81d6c0df3e7c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.184876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 223/468] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:09.184876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fe785-158e-4eee-9607-81d6c0df3e7c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:09.212341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442977-cb30-4098-a5fc-cf4c332eb36e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:09.222835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:09.259732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce47031-b586-46c3-84ec-fa11e5420a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:09.260359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47031-b586-46c3-84ec-fa11e5420a03 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.261655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47031-b586-46c3-84ec-fa11e5420a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.261655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce47031-b586-46c3-84ec-fa11e5420a03 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.261655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47031-b586-46c3-84ec-fa11e5420a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:09.262300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47031-b586-46c3-84ec-fa11e5420a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:09.264235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce47031-b586-46c3-84ec-fa11e5420a03 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:09.277790 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 246/469] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:09.279492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185ba5-e687-4684-8485-f8f2aee5c8fe None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.279936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185ba5-e687-4684-8485-f8f2aee5c8fe None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.280208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185ba5-e687-4684-8485-f8f2aee5c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.302516 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d3185ba5-e687-4684-8485-f8f2aee5c8fe None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:09.305813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d3185ba5-e687-4684-8485-f8f2aee5c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:09.327712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fe785-158e-4eee-9607-81d6c0df3e7c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:09.365404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45452-cbbc-4e8f-addd-8715f4e08401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:09.366037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45452-cbbc-4e8f-addd-8715f4e08401 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.366440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45452-cbbc-4e8f-addd-8715f4e08401 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.366723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45452-cbbc-4e8f-addd-8715f4e08401 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.367404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45452-cbbc-4e8f-addd-8715f4e08401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:09.367712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45452-cbbc-4e8f-addd-8715f4e08401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:09.369132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db45452-cbbc-4e8f-addd-8715f4e08401 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:09.381718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 224/470] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:09.383074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a7fbe-8228-4bd3-81f8-e11c040e64bb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.383461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a7fbe-8228-4bd3-81f8-e11c040e64bb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.383801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a7fbe-8228-4bd3-81f8-e11c040e64bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.404817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7b1a7fbe-8228-4bd3-81f8-e11c040e64bb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:09.406112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7b1a7fbe-8228-4bd3-81f8-e11c040e64bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:09.418872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 247/471] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:09.420382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185ba5-e687-4684-8485-f8f2aee5c8fe None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:09.481214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:09.495705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 225/472] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:09.496826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a7fbe-8228-4bd3-81f8-e11c040e64bb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:09.521692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:09.609226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185ba5-e687-4684-8485-f8f2aee5c8fe None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:09.665426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a7fbe-8228-4bd3-81f8-e11c040e64bb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:09.709222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:09.710579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:09.711468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.712364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:09.712871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.713340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:09.713815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.714279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:09.715191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:09.716964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:09.718820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:09.720593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:09.834384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 226/473] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:13:09 2022] POST /identity/v3/users => generated 248 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:09.840537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:09.867721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 248/474] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:13:09 2022] POST /identity/v3/users => generated 248 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:09.869803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:10.019987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:10.081166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:10.090174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a908c-5423-4995-a1c7-f0843e5a8a56 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:10.101398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef99ee-9e54-418d-9ddd-c29e30d937a0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:10.152674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:10.153855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:10.156291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:10.156912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:10.158116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:10.159132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:10.159822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:10.160100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:10.160369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:10.160765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:10.177405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:10.178919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:10.192635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.sql.core [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 12:13:10.192635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 12:13:10.192635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [parameters: {'id': '2ddbd2a247274924ae3ba6946b562e52', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 12:13:10.192635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:10.196775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:10.197644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:10.198550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:10.198550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:10.198550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:10.199272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 227/475] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:10.204541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Sep 26 12:13:10.219054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return ref.to_dict() Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 12:13:10.220027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application yield resource Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise self.value Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application session.commit() Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 12:13:10.221964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.flush() Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application compat.raise_( Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 12:13:10.223026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 12:13:10.223991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 12:13:10.224966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [parameters: {'id': '2ddbd2a247274924ae3ba6946b562e52', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:10.226210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 12:13:10.227313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:10.228311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 249/476] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Sep 26 12:13:09 2022] POST /identity/v3/roles => generated 144 bytes in 352 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:10.228311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:10.356923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eee31-1b78-41e8-bec7-dda4a86899c2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:10.361864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7f9de-e07d-44d6-a4f2-df6b66c77656 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:10.407532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:10.408362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:10.408940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:10.409369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:10.413490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:10.422929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:10.475801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:10.476920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 250/477] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:13:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:10.477896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:10.478790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:10.478790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:10.478790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:10.478790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:10.479107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:10.479107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:10.479107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:10.479107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 228/478] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:10.496430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:10.499811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:10.571579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586b35d-b28d-44ae-947b-9c4d2c2c52f9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:10.653615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ed3b0-e93b-4eeb-ac39-90727016d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:10.655483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed3b0-e93b-4eeb-ac39-90727016d4ad None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:10.656051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed3b0-e93b-4eeb-ac39-90727016d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:10.657573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed3b0-e93b-4eeb-ac39-90727016d4ad None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:10.658509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ed3b0-e93b-4eeb-ac39-90727016d4ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:10.659951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ed3b0-e93b-4eeb-ac39-90727016d4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:10.661696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ed3b0-e93b-4eeb-ac39-90727016d4ad None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:10.675868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 251/479] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:10.728978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8340074-d4d6-43d6-aa7c-c83e21f75737 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:10.787704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975e562-4fd3-4101-9b57-28364c834671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:10.788326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975e562-4fd3-4101-9b57-28364c834671 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:10.788605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975e562-4fd3-4101-9b57-28364c834671 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:10.788877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975e562-4fd3-4101-9b57-28364c834671 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:10.789535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975e562-4fd3-4101-9b57-28364c834671 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:10.790983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975e562-4fd3-4101-9b57-28364c834671 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:10.919867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 229/480] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:13:10 2022] POST /identity/v3/users => generated 249 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:11.559757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533285c-a8c2-43fb-abeb-ea5c58f6a0bb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:11.560436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533285c-a8c2-43fb-abeb-ea5c58f6a0bb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:11.560745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533285c-a8c2-43fb-abeb-ea5c58f6a0bb None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:11.562335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 252/481] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:11.568208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00f176-8d9e-4307-b79d-4528e5e6975d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:11.568493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00f176-8d9e-4307-b79d-4528e5e6975d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:11.568770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00f176-8d9e-4307-b79d-4528e5e6975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:11.596356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6c00f176-8d9e-4307-b79d-4528e5e6975d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:11.597585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6c00f176-8d9e-4307-b79d-4528e5e6975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:11.638312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:11.696992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 230/482] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:12.024404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533285c-a8c2-43fb-abeb-ea5c58f6a0bb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:12.147498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:12.178471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533285c-a8c2-43fb-abeb-ea5c58f6a0bb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:12.232394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:12.233033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:12.233314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:12.233586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:12.248418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:12.253268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:12.254133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:12.254910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 253/483] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:12.260415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00f176-8d9e-4307-b79d-4528e5e6975d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:12.418540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00f176-8d9e-4307-b79d-4528e5e6975d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:12.472170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c00b80-d187-4a58-8b14-53eb9a0f2129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:12.472800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00b80-d187-4a58-8b14-53eb9a0f2129 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:12.473088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00b80-d187-4a58-8b14-53eb9a0f2129 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:12.473354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c00b80-d187-4a58-8b14-53eb9a0f2129 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:12.474043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c00b80-d187-4a58-8b14-53eb9a0f2129 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:12.474348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c00b80-d187-4a58-8b14-53eb9a0f2129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:12.475780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c00b80-d187-4a58-8b14-53eb9a0f2129 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:12.486269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 231/484] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:12.491996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:12.637979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b627c50-56bb-41fc-b158-ddeed0ad9bed None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:12.637979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b627c50-56bb-41fc-b158-ddeed0ad9bed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:12.637979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b627c50-56bb-41fc-b158-ddeed0ad9bed None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:12.638747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 232/485] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:12.644314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa795-4aca-4ed5-8aeb-29d794cfb634 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:12.644869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa795-4aca-4ed5-8aeb-29d794cfb634 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:12.645340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa795-4aca-4ed5-8aeb-29d794cfb634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:12.650223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f92d25-c9ec-42e8-aca0-bca7603f18d3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:12.666437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-06daa795-4aca-4ed5-8aeb-29d794cfb634 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:12.667961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-06daa795-4aca-4ed5-8aeb-29d794cfb634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:12.694680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:12.695233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:12.695539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:12.695806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:12.706009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:12.708611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:12.710288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:12.729359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:12.731062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:12.732773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:12.732773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:12.732773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:12.732773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 254/486] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:12.737119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:12.737874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:12.861611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88732905-1e06-4548-9da1-1f496cf43bd7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:12.890210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 233/487] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:13:12.901970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5a74f-5e56-48d4-a03f-022bb916696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:12.902602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a74f-5e56-48d4-a03f-022bb916696f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:12.902929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a74f-5e56-48d4-a03f-022bb916696f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:12.903810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5a74f-5e56-48d4-a03f-022bb916696f None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:12.904483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5a74f-5e56-48d4-a03f-022bb916696f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:12.904781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5a74f-5e56-48d4-a03f-022bb916696f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:12.906347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5a74f-5e56-48d4-a03f-022bb916696f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:12.922239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 255/488] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:12.927717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daa795-4aca-4ed5-8aeb-29d794cfb634 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:13.160881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a63f-9767-49e8-a061-be0230af1de9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.161207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a63f-9767-49e8-a061-be0230af1de9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.161481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8a63f-9767-49e8-a061-be0230af1de9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.163108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 256/489] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:13.163418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daa795-4aca-4ed5-8aeb-29d794cfb634 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:13.171058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04d8bb-fad4-4dc3-9d5b-80b25646ce5c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.171333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04d8bb-fad4-4dc3-9d5b-80b25646ce5c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.171719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04d8bb-fad4-4dc3-9d5b-80b25646ce5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.223746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8a04d8bb-fad4-4dc3-9d5b-80b25646ce5c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:13.225277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8a04d8bb-fad4-4dc3-9d5b-80b25646ce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:13.227982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:13.228638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.231674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.231674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.239375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:13.240050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:13.290807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:13.292232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:13.293111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:13.296154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 234/490] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:13:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:13.300721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:13.330183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:13.338507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:13.356796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 257/491] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:13.358040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04d8bb-fad4-4dc3-9d5b-80b25646ce5c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:13.539587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dd82d-4594-49f4-8c04-74496be20827 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:13.564552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04d8bb-fad4-4dc3-9d5b-80b25646ce5c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:13.625032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2acea5-6d4e-4d14-9944-11becabcfa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:13.626197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2acea5-6d4e-4d14-9944-11becabcfa45 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.626884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2acea5-6d4e-4d14-9944-11becabcfa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.627165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2acea5-6d4e-4d14-9944-11becabcfa45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.628843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:13.629449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.629729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.629989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.630737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:13.631036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:13.632724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:13.657571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2acea5-6d4e-4d14-9944-11becabcfa45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1b2acea5-6d4e-4d14-9944-11becabcfa45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:13.662934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:13.664060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:13.664903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:13.669081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 235/492] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:13.670771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c09c-d5a0-4d67-964b-d79a16e56270 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.671041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c09c-d5a0-4d67-964b-d79a16e56270 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.671316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228c09c-d5a0-4d67-964b-d79a16e56270 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.676718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 236/493] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:13.676718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228c09c-d5a0-4d67-964b-d79a16e56270 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:13.700737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 258/494] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:13:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:13.701757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:13.772189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:13.795003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:13.819052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228c09c-d5a0-4d67-964b-d79a16e56270 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:13.843233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f14bb9-4478-4476-89f1-d4b1f236f5eb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:13.868600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567d388-4e2e-4a4e-8e4b-baa2c6755a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:13.869581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567d388-4e2e-4a4e-8e4b-baa2c6755a99 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.869790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567d388-4e2e-4a4e-8e4b-baa2c6755a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.870069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567d388-4e2e-4a4e-8e4b-baa2c6755a99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.879329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:13.879948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.880285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.880564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.881235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:13.881537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:13.882913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:13.883172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567d388-4e2e-4a4e-8e4b-baa2c6755a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3567d388-4e2e-4a4e-8e4b-baa2c6755a99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:13.889581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:13.890484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:13.891284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 237/495] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:13.891974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25a22-1df9-4b7b-a964-f3ce8e0a4d77 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:13.892793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25a22-1df9-4b7b-a964-f3ce8e0a4d77 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:13.892793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c25a22-1df9-4b7b-a964-f3ce8e0a4d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:13.904127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 259/496] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:13.904127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:13.922444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e7c25a22-1df9-4b7b-a964-f3ce8e0a4d77 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:13.924423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e7c25a22-1df9-4b7b-a964-f3ce8e0a4d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:14.015657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 238/497] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:14.016505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c25a22-1df9-4b7b-a964-f3ce8e0a4d77 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.037294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1983c-6dcb-45d6-8967-b1faf64471ff None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.039318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:14.091835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855498d-04e9-4cd2-a33a-c90a336f5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.092459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855498d-04e9-4cd2-a33a-c90a336f5d4e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.092738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855498d-04e9-4cd2-a33a-c90a336f5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.093012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855498d-04e9-4cd2-a33a-c90a336f5d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.148283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:14.198727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c25a22-1df9-4b7b-a964-f3ce8e0a4d77 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.204644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855498d-04e9-4cd2-a33a-c90a336f5d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.206535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855498d-04e9-4cd2-a33a-c90a336f5d4e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.263716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.264697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.265141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.266098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.267265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:14.268188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.270685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.288640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 239/498] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:14.288640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.348489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 260/499] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:14.349774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f69b-3a05-43c2-827a-dbd80af6d010 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.350057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f69b-3a05-43c2-827a-dbd80af6d010 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.350337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192f69b-3a05-43c2-827a-dbd80af6d010 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.351629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 261/500] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:14.352525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f69b-3a05-43c2-827a-dbd80af6d010 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.358312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:14.402009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6362e-c64b-4751-abd3-a1c9656c4be0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.432153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:14.441410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.443991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.443991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.443991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.455832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.457309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.465058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192f69b-3a05-43c2-827a-dbd80af6d010 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:14.472422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:14.473621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:14.474616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:14.474616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.474616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:14.474616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 240/501] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:14.474616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.507548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.508215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.508462 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.508717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.520011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.521474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:14.537109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:14.538360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:14.539181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:14.539181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.539181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:14.539181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 262/502] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:14.539181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.586995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496b0e1-ac0f-484f-a022-8e9684e5976e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.597730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:14.629849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e5a57-defd-401a-9fff-604a86d8b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.630698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5a57-defd-401a-9fff-604a86d8b977 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.631091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5a57-defd-401a-9fff-604a86d8b977 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.631534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e5a57-defd-401a-9fff-604a86d8b977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.643943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e5a57-defd-401a-9fff-604a86d8b977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.645432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e5a57-defd-401a-9fff-604a86d8b977 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.648588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afcfb3-1743-46ba-99e4-d4eebb5a1b9c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7c4e5a57-defd-401a-9fff-604a86d8b977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:14.661265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:14.662233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:14.663295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:14.663295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.663295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:14.663295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 241/503] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:14.663928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f80562-a9e6-4d2f-8aa8-567a9056b5eb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.664132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f80562-a9e6-4d2f-8aa8-567a9056b5eb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.664408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f80562-a9e6-4d2f-8aa8-567a9056b5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.685125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-13f80562-a9e6-4d2f-8aa8-567a9056b5eb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:14.686411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-13f80562-a9e6-4d2f-8aa8-567a9056b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:14.693197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.693834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.694113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.694383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.706126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.707619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.717935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:14.722854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:14.723994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:14.724826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:14.724826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:14.724826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:14.724826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 263/504] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:14.725050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.765071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 242/505] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:14.765943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f80562-a9e6-4d2f-8aa8-567a9056b5eb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.888832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cdf80-4d2c-4b58-8745-eb48f5d2d24b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.896742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f80562-a9e6-4d2f-8aa8-567a9056b5eb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:14.904095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:14.948867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.949589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.950631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.951084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.951957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:14.952457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.954805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.958550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:14.959293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:14.959773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:14.960223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:14.961288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:14.961786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:14.964218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:14.978461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 243/506] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:14.978461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:14.989696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 264/507] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:14.989696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.016653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:15.118753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e81ac1-3682-4b6d-8356-cfa112bd5f58 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.132131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259244b-2520-4dfb-a386-0b9d02d88765 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.171939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.172200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.172560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.172810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.172936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.173085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.173215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.173335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.173737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:15.174014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:15.174178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:15.174352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:15.175499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:15.175767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:15.188817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 265/508] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:15.189692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.191545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 244/509] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:15.193380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.225085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:15.313481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:15.329004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22062376-7de3-46fd-b86a-3a4f71f35b2a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.331528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50d5ce-3c98-446c-92e7-ecceb115b416 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.371944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.372599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.372976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.373261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.377003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.377929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.378348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.378753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.382103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:15.383618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:15.388527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:15.390104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:15.398831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:15.401172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 266/510] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:15.403052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:15.404321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:15.406620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 245/511] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:15.408784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.518972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:15.534579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b891ab-0441-48f1-be97-0a530f6d33c6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.537472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fbb43-c67e-48d6-a8a9-3f1a9c1defb1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.572438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.573075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.573348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.573614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.580140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.580777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.581055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.581327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.582129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:15.583665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:15.593466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:15.598956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:15.600017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:15.600838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 267/512] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:15.601512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:15.607773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:15.608833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:15.609844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 246/513] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:15.611161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.625753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:15.709170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e13cf-7f08-46f0-b647-afef5104f0a7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.744994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.745604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.745884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.746154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.747334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:15.748816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:15.748938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17556430-0900-4f61-911f-a3d79e176d0b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:15.788173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:15.788704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:15.788975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:15.789241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:15.789969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:15.790297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:15.791777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:15.840846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 247/514] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Sep 26 12:13:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:15.841805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.848810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 268/515] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:13:15 2022] POST /identity/v3/users => generated 247 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:15.857350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:15.860442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:15.926390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:15.981558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0025f5-4d26-42b9-93e6-54e9591e4316 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.003711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afcec9-458e-449d-bb90-55bce47dcd2f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.025007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.025775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.026233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.026570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.027466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:16.027842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.029863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.054555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.056111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.056111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.056311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 248/516] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Sep 26 12:13:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:16.056430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.056684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:16.057043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.058501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.062239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:16.069267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 269/517] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:16.071755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:16.158770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:16.196377 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59234cb8-717f-4d36-a024-e6c389969c23 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.208614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b2dc0-e3f7-4ddd-8fbe-cc36c270bcd3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.229401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:16.251058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.252161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.252303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.252663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.252828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.253103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.253206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.253370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.254522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:16.255080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.258102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.287773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 249/518] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:16.289810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:16.338889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.340313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.418664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffd98a-de6a-42f8-a4f4-4ad4bf1322b1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.424282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:16.458989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.459697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.459967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.460246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.496903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 270/519] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:16.496903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:16.536258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:16.570692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.573542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.621080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfe161-3fb7-4d25-aa18-29065396b3cf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.697986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 250/520] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:16.697986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:16.711238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.712354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.712859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.713342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.733568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.736318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:16.764499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:16.765472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:16.766438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:16.766438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:16.766438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:16.771237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 271/521] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:16.772374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:16.796216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:16.803474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:16.824585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6634-d261-494e-8022-1070d498eed4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.868478 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.869098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.869378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.869647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.870390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=952c5c9a37a54497aab20652d0282690) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:16.870694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.872923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.881171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 251/522] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/role_assignments?user.id=952c5c9a37a54497aab20652d0282690&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:16.881171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:16.907053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32283d4-6c5e-4152-890a-00468f379064 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:16.951842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:16.952813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:16.953278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:16.953730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:16.968191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:16.970513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:16.990840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:16.991991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:16.992820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:16.992820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:16.992820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:16.995389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 272/523] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:16.997913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.029243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af85ff-ed1e-4fef-aabc-c69b73cc47c1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.084456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.084998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.085276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.085546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.092863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:17.100643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.102120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.109637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:17.120284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:17.121228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:17.123061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:17.123061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:17.123061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:17.123061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 252/524] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:17.127792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.132816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b5534-bca0-4351-8687-5c79d682d454 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.171407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.172065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.172341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.172663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.173325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:17.173624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.175005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.195494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 273/525] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:17.197056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.274823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb536ff-52c1-43ac-887e-b048e60c208b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.319515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.320308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.320688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.321057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.321706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde04f5-a4fd-4c49-8747-0bf1bc058da5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.321901 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:17.322304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.323969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.339612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 253/526] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:17.340978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.355400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:17.365553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.369661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.369661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.369661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.369661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:17.369661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.369661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 274/527] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:17.385551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.418794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:17.469825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b765-2159-444c-be75-9a3624a25c96 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.514050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.514261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6d91d-ee01-4159-a536-82df39b03650 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.515170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.515815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.516294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.525332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.527229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:17.543060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:17.545073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 12:13:17.546566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:17.549814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 254/528] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:17.551054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.558910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.559544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.559895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.560182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.568771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.570494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:17.585058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:17.585995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:17.587494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 275/529] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:17.588073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.655473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:17.716148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6560-ab10-442f-83bd-2ad91563aa28 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.720291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6247e-a95f-407f-aa93-cde61e56cad0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.739199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:17.764210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.764902 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.765240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.765601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.768754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.769685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.770199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.770669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.771738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:17.772260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.773902 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.774270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.775381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:17.791259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:17.792408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:17.793443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:17.796904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 255/530] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:17.798017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.805081 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 276/531] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:17.806510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:17.935002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aedd8-9742-4c5c-b108-8f6415653429 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.938239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fd7a2-9f9e-430e-8a28-86cf4a8562af None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:17.946442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:17.979550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.980217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.981161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.981819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.982636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:17.983153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.984183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:17.985123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:17.985337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:17.985723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:17.986295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:17.987743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:17.988401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:17.990317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:18.007284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 256/533] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:18.007682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 277/533] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:18.008795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:18.013146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:18.066639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:18.161522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9d5a4-1987-46b3-aad3-9d409a142f53 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:18.162222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56d431-787e-43de-b53c-392c691c8616 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:18.201600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:18.202663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:18.203138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:18.203634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:18.204580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=91af8e7c2dcd41e480e1b1a086ba2688) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:18.205102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:18.207591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:18.214623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 278/534] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:18 2022] GET /identity/v3/role_assignments?user.id=91af8e7c2dcd41e480e1b1a086ba2688&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:18.216440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:18.240823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:18.240823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:18.240823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:18.240823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:18.262181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:18.346415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:18.348042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:18.364322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c1464-c955-4e80-a126-cc556e699eac None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:18.400965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:18.407473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb22b9-f2b3-4b23-84c8-2fecfdca1c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:18.408099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb22b9-f2b3-4b23-84c8-2fecfdca1c87 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:18.408378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb22b9-f2b3-4b23-84c8-2fecfdca1c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:18.408660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb22b9-f2b3-4b23-84c8-2fecfdca1c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:18.409426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb22b9-f2b3-4b23-84c8-2fecfdca1c87 None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=957e46599f5d4d21b822e8c9ce1480b6) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:18.409742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb22b9-f2b3-4b23-84c8-2fecfdca1c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:18.411243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb22b9-f2b3-4b23-84c8-2fecfdca1c87 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:18.427534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 279/535] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:18 2022] GET /identity/v3/role_assignments?user.id=957e46599f5d4d21b822e8c9ce1480b6&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:18.429389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ae0a-ffb6-4ed3-b41e-4756843eae9a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:18.429844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ae0a-ffb6-4ed3-b41e-4756843eae9a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:18.430261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ae0a-ffb6-4ed3-b41e-4756843eae9a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:18.431805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 280/536] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:18.439375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef48cb-4bc8-4d7b-a3e8-72179211f1dd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:18.439722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef48cb-4bc8-4d7b-a3e8-72179211f1dd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:18.439910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef48cb-4bc8-4d7b-a3e8-72179211f1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:18.470817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-49ef48cb-4bc8-4d7b-a3e8-72179211f1dd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:18.471997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-49ef48cb-4bc8-4d7b-a3e8-72179211f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:18.531086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 257/537] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:18.540667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:18.552235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 281/538] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:13:18.711927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309c16c-1915-4d03-98f2-003543974e98 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:18.759848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:18.760434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:18.760711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:18.760979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:18.769864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:18.776600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:18.778628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:18.798706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:18.801074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:18.802792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:18.802792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:18.802792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:18.802792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 258/539] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:18.805662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef48cb-4bc8-4d7b-a3e8-72179211f1dd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:18.857138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:18.947067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:18.963525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef48cb-4bc8-4d7b-a3e8-72179211f1dd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:19.040717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:19.041268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.041548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.041822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.042492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:19.042794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:19.044767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:19.070432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 282/540] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:19.074076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:19.180655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fad7e4-b6cd-4f54-a568-1a077513d11a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:19.235999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:19.262531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0aa24-1bb1-4b59-806c-562d8cc5a0c9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:19.264682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:19.265374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.265659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.265925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.286207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:19.295028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:19.295959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:19.296733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:19.302599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 259/541] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:19.309757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:19.337600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bc581-7466-47d1-924a-3ac4389c79fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:19.338582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bc581-7466-47d1-924a-3ac4389c79fc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.338860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bc581-7466-47d1-924a-3ac4389c79fc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.339133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bc581-7466-47d1-924a-3ac4389c79fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.348390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bc581-7466-47d1-924a-3ac4389c79fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:19.349865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bc581-7466-47d1-924a-3ac4389c79fc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-071bc581-7466-47d1-924a-3ac4389c79fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:19.365103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:19.366023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:19.366841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:19.367662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 283/542] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:19.369515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a9918-7d24-4156-8890-ea13a18caa20 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.370259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a9918-7d24-4156-8890-ea13a18caa20 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.370549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a9918-7d24-4156-8890-ea13a18caa20 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.373813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 284/543] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:19.374692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a9918-7d24-4156-8890-ea13a18caa20 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:19.382561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:19.459972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d09bc-5ccf-4f2c-9139-7ad20ef756c4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:19.516015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08aec4-f4eb-40b5-9702-cf3fd2ebb36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:19.517373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08aec4-f4eb-40b5-9702-cf3fd2ebb36c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.518152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08aec4-f4eb-40b5-9702-cf3fd2ebb36c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.518614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08aec4-f4eb-40b5-9702-cf3fd2ebb36c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.519738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08aec4-f4eb-40b5-9702-cf3fd2ebb36c None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:19.520620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08aec4-f4eb-40b5-9702-cf3fd2ebb36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:19.522476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08aec4-f4eb-40b5-9702-cf3fd2ebb36c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:19.524044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a9918-7d24-4156-8890-ea13a18caa20 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:19.535605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 260/544] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:19.538809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148226-e52a-4efe-9b3a-9cfeafce5ad0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.539644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148226-e52a-4efe-9b3a-9cfeafce5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.540282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148226-e52a-4efe-9b3a-9cfeafce5ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.567029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:19.567242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2b148226-e52a-4efe-9b3a-9cfeafce5ad0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:19.567610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.567891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.568161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.568877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:19.569184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:19.569742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2b148226-e52a-4efe-9b3a-9cfeafce5ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:19.570847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:19.591781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 285/545] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:19.593045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:19.600989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:19.659574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 261/546] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:19.660603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148226-e52a-4efe-9b3a-9cfeafce5ad0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:19.708818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14c09-3766-476d-aaf6-b12e02f079c4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:19.739283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:19.761638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:19.763250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.763555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.764039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.788265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:19.789755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:19.805909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:19.807272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:19.808946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:19.808946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:19.808946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:19.810380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148226-e52a-4efe-9b3a-9cfeafce5ad0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:19.811968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 286/547] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:19.814755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:19.850070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:19.851112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:19.851640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:19.852129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:19.853064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=5c06385b20074363b3a5f7216947280b) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:19.853588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:19.855307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:19.862588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 262/548] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:19 2022] GET /identity/v3/role_assignments?user.id=5c06385b20074363b3a5f7216947280b&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:19.895747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:19.978775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:19.978969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f108dc-7b4d-471e-8633-5586637916ae None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:20.034214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:20.034860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.035134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.035433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.036147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:20.037915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:20.039261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:20.061060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 287/549] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:20.069612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:20.173224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9088828-cc8c-4f02-85f7-952cd52bb0f3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:20.193729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:20.257926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd700a8d-0b3d-44e2-a980-6a32e97ad9f1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:20.266283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:20.267266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.267781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.268274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.276853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:20.291969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:20.307378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:20.308328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:20.310051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:20.313328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 263/550] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:20.315254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:20.316385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.317038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.317837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.319803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:20.339232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:20.344004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:20.362364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:20.363323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:20.364279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:20.374894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 288/551] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:20.379165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:20.499548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768fa5a-86bb-4de4-aa26-9f08cdfb084c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:20.524135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aafaae-5735-4b20-92b1-b5708eeed863 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:20.548830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:20.550018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.550306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.550579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.551329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:20.551739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:20.555083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:20.576679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 289/552] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Sep 26 12:13:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:20.584399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:20.601704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:20.602353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.602619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.602882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.603570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:20.603869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:20.605241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:20.622074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 264/553] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:20.626929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:20.655706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:20.679183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:20.784323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf037e2-739a-4e14-9143-2b7baada6be4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:20.831356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78fa77-9877-48a8-a017-ef840315acca None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:20.876849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308428f7-732b-48d0-a9e3-02cbb70d0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:20.877503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308428f7-732b-48d0-a9e3-02cbb70d0fec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.878238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308428f7-732b-48d0-a9e3-02cbb70d0fec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.878552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308428f7-732b-48d0-a9e3-02cbb70d0fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.883576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:20.884185 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.884471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.884743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.907880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308428f7-732b-48d0-a9e3-02cbb70d0fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:20.909440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308428f7-732b-48d0-a9e3-02cbb70d0fec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-308428f7-732b-48d0-a9e3-02cbb70d0fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:20.934845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:20.936228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:20.937434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:20.937434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:20.937434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:20.937434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 265/554] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:20.937651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39eea0-9596-4f7e-b68c-fdbd428bf1c6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:20.937975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39eea0-9596-4f7e-b68c-fdbd428bf1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:20.938423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39eea0-9596-4f7e-b68c-fdbd428bf1c6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:20.942800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 266/555] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:20.947875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39eea0-9596-4f7e-b68c-fdbd428bf1c6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:20.985895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:20.987950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.042109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.049545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.073204 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39eea0-9596-4f7e-b68c-fdbd428bf1c6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.118070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd542f8f-ba96-4885-9887-bd90ff838a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.118893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542f8f-ba96-4885-9887-bd90ff838a8c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.119235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542f8f-ba96-4885-9887-bd90ff838a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.119630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542f8f-ba96-4885-9887-bd90ff838a8c None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.120370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd542f8f-ba96-4885-9887-bd90ff838a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:21.120771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd542f8f-ba96-4885-9887-bd90ff838a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:21.122806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd542f8f-ba96-4885-9887-bd90ff838a8c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.139637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 267/556] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:21.141349 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7637d-7e18-4a4d-8934-2f76d9a1641e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.141708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7637d-7e18-4a4d-8934-2f76d9a1641e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.142053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7637d-7e18-4a4d-8934-2f76d9a1641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.154448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 290/557] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:21.159589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.167472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-54b7637d-7e18-4a4d-8934-2f76d9a1641e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:21.168993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-54b7637d-7e18-4a4d-8934-2f76d9a1641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:21.267370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 268/558] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:21.267370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7637d-7e18-4a4d-8934-2f76d9a1641e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.294166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b0e68-cc82-4712-b4d4-e646337e6b67 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.344078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92134d-c52c-4c11-b0fb-0d090b056cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.345042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92134d-c52c-4c11-b0fb-0d090b056cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.345326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92134d-c52c-4c11-b0fb-0d090b056cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.345598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92134d-c52c-4c11-b0fb-0d090b056cb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.348843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.349784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.357803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92134d-c52c-4c11-b0fb-0d090b056cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:21.359328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92134d-c52c-4c11-b0fb-0d090b056cb2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ad92134d-c52c-4c11-b0fb-0d090b056cb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:21.373315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:21.374330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:21.375241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 291/559] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:21.376249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d835-6b07-4392-9d92-80d55ec794ce None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.376249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d835-6b07-4392-9d92-80d55ec794ce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.376249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160d835-6b07-4392-9d92-80d55ec794ce None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.378675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 292/560] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:21.380718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160d835-6b07-4392-9d92-80d55ec794ce None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.396163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7637d-7e18-4a4d-8934-2f76d9a1641e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.434271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ac396-49be-412b-91f3-fba65358c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.435195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac396-49be-412b-91f3-fba65358c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.435794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac396-49be-412b-91f3-fba65358c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.436237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac396-49be-412b-91f3-fba65358c7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.447526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ac396-49be-412b-91f3-fba65358c7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:21.449250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ac396-49be-412b-91f3-fba65358c7e6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-892ac396-49be-412b-91f3-fba65358c7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:21.466670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:21.467707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:21.468574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:21.468574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:21.468574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:21.470788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 269/561] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:21.472371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cb399-96f9-4753-93bc-8e35af62cfed None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.472887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cb399-96f9-4753-93bc-8e35af62cfed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.473367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cb399-96f9-4753-93bc-8e35af62cfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.493094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a59cb399-96f9-4753-93bc-8e35af62cfed None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:21.494819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a59cb399-96f9-4753-93bc-8e35af62cfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:21.506704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160d835-6b07-4392-9d92-80d55ec794ce None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.548022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.548573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.548853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.549129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.549870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:21.550176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:21.551640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.572289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 293/562] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:21.573217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.592711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 270/563] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:21.593942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cb399-96f9-4753-93bc-8e35af62cfed None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.654661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.659802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.705987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cb399-96f9-4753-93bc-8e35af62cfed None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.710519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4e08-00d9-40b4-af75-2735b0b2dfa6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.750342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.750985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.751267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.751568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.761533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.762857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.763364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:21.763661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.764123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.764838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.765219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:21.765749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:21.768123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:21.780653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:21.781672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:21.783106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:21.783106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:21.783106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:21.783106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 271/564] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:21.783106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.790303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 294/565] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:21.791239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.918594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c68248-cf15-4cef-b113-ca257c61cedb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.919211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b44a91-d154-4a8c-a816-6be13fe1155b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:21.922788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.935983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:21.961709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.962377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.962658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.962925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.963044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:21.963608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:21.963710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:21.963909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:21.964018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:21.964194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:21.965351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:21.975698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:21.984709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 295/566] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:21.984709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:21.985003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:21.985813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 272/567] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:21.986629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.114160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd8b79-e950-4067-b802-4c50b38f2cd4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.118334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb5762-82a5-467f-b1ba-7ffdc30a8759 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.150888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.151547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.151827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.152094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.161324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.161955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.162233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.162522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.163634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:22.169085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:22.170237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:22.171057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:22.173201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.174803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.175323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 273/568] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:22.176109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:22.188082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:22.189044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 296/569] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:22.195076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.218283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:22.234523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:22.303023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa59c90-398b-4ec6-b9dc-5e3729dc4f04 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.319338 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af148924-0e96-4e19-8c2e-4597e05edd45 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.357056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.357695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.357972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.358240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.365582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.367023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.367284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.367929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.368242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.368499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.369161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:22.369466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.370817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:22.389720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:22.391404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:22.393052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:22.393834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 297/570] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:22.393834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.394065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 274/571] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:22.394065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.488329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:22.502766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35600152-d374-4a82-bf7c-13e0ceb24f80 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.503284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:22.510359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd4a68-20b9-47c3-9746-db3f8b821f65 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.541736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.542350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.542630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.542903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.543665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:22.543969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.545580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.548479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.549087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.549376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.549707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.550563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:22.550677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.553993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.565769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 275/572] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:22.565769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.566094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 298/573] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:22.566970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.676878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a011a-bfbc-4215-8e43-6f13daf32882 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.683210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc2d1-697e-452d-8ae9-48ed6b4f5cc6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.712571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c3ead-ee2c-4731-9f9e-47626fbb84a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.713183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3ead-ee2c-4731-9f9e-47626fbb84a5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.713468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3ead-ee2c-4731-9f9e-47626fbb84a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.713743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c3ead-ee2c-4731-9f9e-47626fbb84a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.714444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c3ead-ee2c-4731-9f9e-47626fbb84a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:22.714751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c3ead-ee2c-4731-9f9e-47626fbb84a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.716270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c3ead-ee2c-4731-9f9e-47626fbb84a5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.718141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.718779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.719060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.719335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.728021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 299/574] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:22.729363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878946c8-6893-4da2-8bc4-becc4fd06aa5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.729650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878946c8-6893-4da2-8bc4-becc4fd06aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.729927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878946c8-6893-4da2-8bc4-becc4fd06aa5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.731695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 300/575] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:22.732451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878946c8-6893-4da2-8bc4-becc4fd06aa5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.737343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.738868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.741697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:22.751729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:22.755638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:22.761599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:22.762872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:22.762872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:22.762872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:22.762872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 276/576] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:22.762872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.858067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878946c8-6893-4da2-8bc4-becc4fd06aa5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.884001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079032-3cd7-4a98-bf78-91a61e0ba875 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:22.899625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.900615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.900903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.901166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.901908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=b99893144ac74cc9aec6d197c3dc1bc9) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:22.902223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.903741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.909469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 301/577] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/role_assignments?user.id=b99893144ac74cc9aec6d197c3dc1bc9&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:22.910275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:22.943980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e25af2-22ba-4796-b0d4-27a93d7a4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:22.944660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e25af2-22ba-4796-b0d4-27a93d7a4853 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.945787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e25af2-22ba-4796-b0d4-27a93d7a4853 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.946076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e25af2-22ba-4796-b0d4-27a93d7a4853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:22.961544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e25af2-22ba-4796-b0d4-27a93d7a4853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:22.964053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e25af2-22ba-4796-b0d4-27a93d7a4853 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b8e25af2-22ba-4796-b0d4-27a93d7a4853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:22.982833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:22.983894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:22.984767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:22.984767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:22.984767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:22.984767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 277/578] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:22.985690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a564d5-7336-4af2-97a0-e768e713e8ee None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:22.985690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a564d5-7336-4af2-97a0-e768e713e8ee None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:22.985873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a564d5-7336-4af2-97a0-e768e713e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.006399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e5a564d5-7336-4af2-97a0-e768e713e8ee None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:23.007610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e5a564d5-7336-4af2-97a0-e768e713e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:23.020831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:23.042675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804e916-d281-4469-baf8-9e7a0657e306 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:23.061879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:23.086882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:23.087621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:23.087968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:23.088238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/952c5c9a37a54497aab20652d0282690/roles/e5d4d76180364a138e4c8c41652caa4d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.097429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 278/579] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:23.098918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a564d5-7336-4af2-97a0-e768e713e8ee None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.106206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=952c5c9a37a54497aab20652d0282690, role_id=e5d4d76180364a138e4c8c41652caa4d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:23.107859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:23.185515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 302/580] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:22 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/952c5c9a37a54497aab20652d0282690/roles/e5d4d76180364a138e4c8c41652caa4d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:13:23.187364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.247301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a564d5-7336-4af2-97a0-e768e713e8ee None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:23.304027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:23.307191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:23.307784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:23.308298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.310062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:23.313794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:23.316865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:23.347133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 279/581] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:23.351503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.432196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:23.442016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3d04b-acf6-4133-8fe4-92cd25fed00c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:23.475941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:23.482184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:23.482965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:23.483126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:23.483429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.484389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:23.484694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:23.487139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:23.502046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 303/582] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:23.503169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.530371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2071f6-a549-4789-bca0-500830f6f525 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:23.576263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:23.576900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:23.577178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:23.577456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.587235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:23.589037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:23.605464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:23.607000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:13:23.608110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:23.614447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 280/583] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:23.614447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.631669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48f28-2454-4cd1-9f02-f6b451acb5e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:23.682324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:23.683480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:23.684653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:23.685276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.701096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:23.707602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:23.708590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:23.709440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:23.718832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 304/584] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:23.720110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.746770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:23.751146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da8d00-945f-455c-97a7-36a1798bc7c3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:23.794364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:23.795408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:23.795659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:23.796029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.804472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:23.805898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:23.811770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:23.819569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:23.820608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:23.821538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 281/585] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:23.822107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.876031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432aaf2-4ab9-45ee-98df-7736027dd0e5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:23.914651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:23.915376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:23.915854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:23.916198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:23.917009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:23.917382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:23.919263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:23.940436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 305/586] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:23.941449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:23.974660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d52875-9b01-4394-835d-5ab07fe1f849 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.014318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.015045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.015422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.015756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.016498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:24.016864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.018334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.031681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 282/587] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:24.032980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.059484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:24.087830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9826b92-6d73-4f0f-a529-242055f18d10 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.100819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:24.130772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.131495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.131905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.132295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.133601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:24.134006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.136611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.165898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 306/588] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Sep 26 12:13:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:24.165898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.182632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418374e-288f-4486-b7a6-c580bc1f335a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.235632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.237201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.237628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.238027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.254044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.256734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:24.278643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:24.279870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:24.280945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:24.280945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:24.280945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:24.287564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 283/589] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:24.287564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.309277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f23157-416b-4e20-ac0b-04b113859911 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.351191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.352223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.352728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.353194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.366956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.368610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.376656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:24.392100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:24.393046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:24.393905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:24.393905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:24.393905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:24.393905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 307/590] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:24.393905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.417294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:24.419469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788556a-b698-4ad5-8259-6b6bc9d56492 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.462753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.463826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.464582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.465005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.481492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.486656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:24.505331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:24.506289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:24.507155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:24.507155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:24.507155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:24.514172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 284/591] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:24.514172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.523217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7560d-41cb-4627-b478-c606546b50c8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.564714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.565951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.566618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.567092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.568523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:24.569030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.571456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.591854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 308/592] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:24.591854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.651927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635eee0-a6da-4d6b-baee-51d8b7d0580c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.678522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:24.691821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.698415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:24.698548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.698548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.698548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.698548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:24.698548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.698548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.710459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 285/593] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:24.711493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.719999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c20505-ae9d-43ea-9458-464c15ffba95 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.771142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.772681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.773417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.773873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.774918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:24.775434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.777434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.798226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 309/594] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:24.798226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.839083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5d15-1143-4862-a040-2c9f18d36bf8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.876998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.877642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.877922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.878195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.885983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.888285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:24.900952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:24.901896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:24.903593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:24.907878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 286/595] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:24.908776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:24.928013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fb0f1-9c14-4809-8011-be2b06aa4bb7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:24.967748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:24.972496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:24.973722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:24.974206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:24.974676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:24.985309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:24.987811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:24.995897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:25.003701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:25.004662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 12:13:25.005606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:25.008379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 310/596] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:25.009727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:25.046504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a48a2-a405-4d71-8104-c50dc15bd3cf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.107707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.109119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.109502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.109897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.120411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.122811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.137386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a957318e-99c2-4051-a2e6-17d44abcb1dc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:25.141302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:25.142318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:25.143247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:25.147872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 287/597] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:25.149438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:25.181086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.182692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.183207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.183951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.184956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:25.185475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.187162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.207192 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 311/598] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:25.208010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:25.266517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf1ce-465e-4793-8954-499569340d74 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.269964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:25.274359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:25.302668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612f09-e372-4598-a2ee-76f380816efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.303277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f09-e372-4598-a2ee-76f380816efc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.303586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f09-e372-4598-a2ee-76f380816efc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.303860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612f09-e372-4598-a2ee-76f380816efc None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.304589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612f09-e372-4598-a2ee-76f380816efc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:25.304964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612f09-e372-4598-a2ee-76f380816efc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.306447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612f09-e372-4598-a2ee-76f380816efc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.319293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ea108-fae4-43e2-a8cc-fa5bde10f800 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.326396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 288/599] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Sep 26 12:13:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:25.327492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d532a-4cf6-436c-af01-7da021f44d38 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.327779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d532a-4cf6-436c-af01-7da021f44d38 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.328054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d532a-4cf6-436c-af01-7da021f44d38 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.329550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 289/600] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:25.330252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d532a-4cf6-436c-af01-7da021f44d38 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:25.367527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.368137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.368418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.368689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.369387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:25.369693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.371154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.389186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 312/601] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:25.389186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:25.448050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d532a-4cf6-436c-af01-7da021f44d38 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.485997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.486952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.487228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.487539 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/91af8e7c2dcd41e480e1b1a086ba2688/roles/e5d4d76180364a138e4c8c41652caa4d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.501072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71285293-bc3c-4350-8aeb-2b69ffae3531 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.503734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=91af8e7c2dcd41e480e1b1a086ba2688, role_id=e5d4d76180364a138e4c8c41652caa4d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.505241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.520333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:25.537597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6ea48-4f2d-4838-b630-c6a28ed7f3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.538225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6ea48-4f2d-4838-b630-c6a28ed7f3ec None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.538505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6ea48-4f2d-4838-b630-c6a28ed7f3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.538777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6ea48-4f2d-4838-b630-c6a28ed7f3ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.551172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6ea48-4f2d-4838-b630-c6a28ed7f3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.553098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6ea48-4f2d-4838-b630-c6a28ed7f3ec None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-06e6ea48-4f2d-4838-b630-c6a28ed7f3ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:25.567200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:25.568173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:25.569062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:25.569062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:25.569062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:25.569062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 313/602] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:25.569699 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17746c-661b-4e47-97f2-f14556a5d525 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.569985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17746c-661b-4e47-97f2-f14556a5d525 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.570257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17746c-661b-4e47-97f2-f14556a5d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.588872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cb17746c-661b-4e47-97f2-f14556a5d525 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:25.590052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cb17746c-661b-4e47-97f2-f14556a5d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:25.615759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 290/603] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:25 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/91af8e7c2dcd41e480e1b1a086ba2688/roles/e5d4d76180364a138e4c8c41652caa4d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:13:25.616564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:25.646304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:25.695436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 314/604] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:25.695436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17746c-661b-4e47-97f2-f14556a5d525 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:25.826207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:25.830520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17746c-661b-4e47-97f2-f14556a5d525 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.831468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d62517-f470-4a77-9f0f-49c0880b2fce None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:25.874117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.875663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.876152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.876628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/957e46599f5d4d21b822e8c9ce1480b6/roles/e5d4d76180364a138e4c8c41652caa4d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.877553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:25.878156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:25.878437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:25.878703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:25.879373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:25.879683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.881400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.897086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=957e46599f5d4d21b822e8c9ce1480b6, role_id=e5d4d76180364a138e4c8c41652caa4d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:25.897353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 315/605] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:25.899132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:25.903321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:26.003934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 291/606] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:25 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/957e46599f5d4d21b822e8c9ce1480b6/roles/e5d4d76180364a138e4c8c41652caa4d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:13:26.010547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f363-2180-4e9d-a69e-1691296045a8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:26.048998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:26.050022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:26.050533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:26.051001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:26.059085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:26.060884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:26.080428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:26.082037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:26.089259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 316/607] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:26.091194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:26.174681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:26.178242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:26.224937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1319-ba52-4b37-a50e-4185aceaf334 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:26.232555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:26.281367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:26.282020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:26.282416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:26.282909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:26.287797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:26.288215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:26.292850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:26.313811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 292/608] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:26.319958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:26.396075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858720ec-17ff-4a3e-b94d-e56bbccdc0f6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:26.442851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:26.443636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:26.443982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:26.444231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:26.464243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:26.477501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:26.481171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:26.484505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 317/609] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:26.491399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:26.532172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf578c-1d04-45f5-b5bc-6c760a693509 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:26.603900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:26.608121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:26.617854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2b9a6-a0e2-43d1-a6ca-1830111cf779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:26.618537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b9a6-a0e2-43d1-a6ca-1830111cf779 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:26.618809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b9a6-a0e2-43d1-a6ca-1830111cf779 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:26.619082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b9a6-a0e2-43d1-a6ca-1830111cf779 None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/5c06385b20074363b3a5f7216947280b/roles/e5d4d76180364a138e4c8c41652caa4d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:26.638282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a887834-2f49-4cdd-a941-6da36742ecb1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:26.641841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b9a6-a0e2-43d1-a6ca-1830111cf779 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=5c06385b20074363b3a5f7216947280b, role_id=e5d4d76180364a138e4c8c41652caa4d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:26.641841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2b9a6-a0e2-43d1-a6ca-1830111cf779 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:26.684706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece37d9-115e-4528-9228-6a79f1288575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:26.685337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece37d9-115e-4528-9228-6a79f1288575 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:26.685619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece37d9-115e-4528-9228-6a79f1288575 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:26.685893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece37d9-115e-4528-9228-6a79f1288575 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:26.686576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece37d9-115e-4528-9228-6a79f1288575 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:26.686881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece37d9-115e-4528-9228-6a79f1288575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:26.688329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece37d9-115e-4528-9228-6a79f1288575 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:26.698209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 318/610] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:26.703618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010da0ab-fbd3-4066-9d87-121e129f6160 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:26.703618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010da0ab-fbd3-4066-9d87-121e129f6160 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:26.703618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010da0ab-fbd3-4066-9d87-121e129f6160 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:26.706203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 319/611] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:26.707165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010da0ab-fbd3-4066-9d87-121e129f6160 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:26.777069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 293/612] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:26 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/5c06385b20074363b3a5f7216947280b/roles/e5d4d76180364a138e4c8c41652caa4d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:13:26.778959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320dafe-3446-424a-b0cf-55551913584b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:26.779547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320dafe-3446-424a-b0cf-55551913584b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:26.780047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320dafe-3446-424a-b0cf-55551913584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:26.806087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2320dafe-3446-424a-b0cf-55551913584b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:26.808633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2320dafe-3446-424a-b0cf-55551913584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:26.944038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 294/613] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:26.953047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010da0ab-fbd3-4066-9d87-121e129f6160 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:27.007023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:27.007023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:27.007023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:27.007410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:27.024781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:27.026283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:27.029066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:27.048970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:27.049949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:27.050882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:27.050882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:27.050882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:27.050882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 320/614] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:27.057747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320dafe-3446-424a-b0cf-55551913584b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:27.208018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320dafe-3446-424a-b0cf-55551913584b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:27.209866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:27.255227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:27.256194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:27.256688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:27.257193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:27.258025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:27.258546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:27.260250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:27.278619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 295/615] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:27.285289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:27.303553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:27.434732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ac0f-de78-415e-b23c-479383e27ccc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:27.498173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:27.499241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:27.499795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:27.500309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:27.530223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:27.537821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:27.538800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:27.539767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:27.548030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 296/616] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:27.554052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:27.560270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a2324-103f-48bc-94ba-f56b12d2582e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:27.599109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:27.601506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:27.602464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:27.602949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:27.603461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:27.612564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:27.614533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:27.628047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:27.629064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:27.630205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:27.633179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 321/617] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:27.640756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:27.717827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f277d-ce9a-4fc3-a1a0-755d21df471e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:27.739374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:27.773121 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:27.773923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:27.774202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:27.774475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:27.775167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:27.775504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:27.776911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:27.801138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 297/618] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:27.808205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:27.869721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d7dc-877a-45ec-bd85-395cb3749de7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:27.940700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:27.966678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d0d6-0fdf-4d93-9e15-100ab697082a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:27.973167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:27.973870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:27.974154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:27.974432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:27.975200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:27.975539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:27.976994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:28.032000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 322/619] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Sep 26 12:13:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:28.038453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:28.049545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:28.050604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:28.053468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:28.053468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:28.091041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:28.092829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:28.142841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:28.144137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:28.145904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:28.145904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:28.145904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:28.146519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 298/620] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:28.150800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:28.232409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79642b07-5071-47e5-92b6-2e07b3534f33 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:28.278120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:28.320112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:28.321613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:28.322102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:28.322589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:28.336173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:28.338297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:28.369149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:28.370151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:28.371140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:28.371140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:28.371140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:28.382764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 323/621] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:28.384401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:28.392237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034c48-a548-46de-825f-fb4fb6aeecca None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:28.462640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b083ffe-9e5b-4827-8a46-48c4037992c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:28.463365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b083ffe-9e5b-4827-8a46-48c4037992c6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:28.463682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b083ffe-9e5b-4827-8a46-48c4037992c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:28.463925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b083ffe-9e5b-4827-8a46-48c4037992c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:28.464579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b083ffe-9e5b-4827-8a46-48c4037992c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:28.464879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b083ffe-9e5b-4827-8a46-48c4037992c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:28.466850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b083ffe-9e5b-4827-8a46-48c4037992c6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:28.469672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:28.493993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 299/622] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:28.495821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39847700-ca86-4f10-a978-f130f55f03e7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:28.498753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39847700-ca86-4f10-a978-f130f55f03e7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:28.499283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39847700-ca86-4f10-a978-f130f55f03e7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:28.506723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 300/623] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:28.508018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39847700-ca86-4f10-a978-f130f55f03e7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:28.569818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef25a64-4b71-48f5-a3a4-b596e82b8ad5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:28.610473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed5eba-b68b-499f-9b2a-25404f323e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:28.611487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed5eba-b68b-499f-9b2a-25404f323e95 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:28.611975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed5eba-b68b-499f-9b2a-25404f323e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:28.612479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed5eba-b68b-499f-9b2a-25404f323e95 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:28.613530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed5eba-b68b-499f-9b2a-25404f323e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:28.614108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed5eba-b68b-499f-9b2a-25404f323e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:28.615880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed5eba-b68b-499f-9b2a-25404f323e95 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:28.632542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 324/624] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:28.634316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72150-c348-4891-b0f1-31a7a509e19b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:28.634814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72150-c348-4891-b0f1-31a7a509e19b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:28.635387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb72150-c348-4891-b0f1-31a7a509e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:28.662089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cbb72150-c348-4891-b0f1-31a7a509e19b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:28.663791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cbb72150-c348-4891-b0f1-31a7a509e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:28.667595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39847700-ca86-4f10-a978-f130f55f03e7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:28.686827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:28.712862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:28.713507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:28.713786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:28.714057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:28.731883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:28.731883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:28.748125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:28.749144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:28.750198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:28.754388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 301/625] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:13:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:28.755941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:28.769593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 325/626] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:28.770895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72150-c348-4891-b0f1-31a7a509e19b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:28.878749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:28.990301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb72150-c348-4891-b0f1-31a7a509e19b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:28.992797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ec3f4-dedc-470e-a683-ab00c31ae603 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.031610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832017f4-de98-4a49-bcca-7a940dbe5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.032258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832017f4-de98-4a49-bcca-7a940dbe5184 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.032537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832017f4-de98-4a49-bcca-7a940dbe5184 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.032808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832017f4-de98-4a49-bcca-7a940dbe5184 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.040115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258df79c-ed62-456a-a243-228fb3aa74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.040728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df79c-ed62-456a-a243-228fb3aa74b8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.040908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832017f4-de98-4a49-bcca-7a940dbe5184 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:29.041024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df79c-ed62-456a-a243-228fb3aa74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.041267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258df79c-ed62-456a-a243-228fb3aa74b8 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.042013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258df79c-ed62-456a-a243-228fb3aa74b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:29.042318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258df79c-ed62-456a-a243-228fb3aa74b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:29.042452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832017f4-de98-4a49-bcca-7a940dbe5184 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:29.044741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258df79c-ed62-456a-a243-228fb3aa74b8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-832017f4-de98-4a49-bcca-7a940dbe5184 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:29.055908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:29.057134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:29.058306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 302/627] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:29.059910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d4dd-ed65-40f6-886b-17a46c6065a3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.059910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d4dd-ed65-40f6-886b-17a46c6065a3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.059910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d4dd-ed65-40f6-886b-17a46c6065a3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.064731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 303/628] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:29.066181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518d4dd-ed65-40f6-886b-17a46c6065a3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:29.072926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 326/629] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:13:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:29.072926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862805d-e4d1-4f55-b85a-08d96e5fcc07 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.073358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862805d-e4d1-4f55-b85a-08d96e5fcc07 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.073358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862805d-e4d1-4f55-b85a-08d96e5fcc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.105768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8862805d-e4d1-4f55-b85a-08d96e5fcc07 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:29.107593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8862805d-e4d1-4f55-b85a-08d96e5fcc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:29.117309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:29.194163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 327/630] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:29.195567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862805d-e4d1-4f55-b85a-08d96e5fcc07 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:29.225647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518d4dd-ed65-40f6-886b-17a46c6065a3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.265104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:29.289348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.290282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.290737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.291333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.292239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:29.293173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:29.296023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:29.317179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 304/631] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:29.317179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:29.350600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862805d-e4d1-4f55-b85a-08d96e5fcc07 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.398287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.399312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.399846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.400852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.422221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:29.435040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200cb3f-3ec7-4b59-809f-ff3295341327 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.491078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.491655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.491970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.492276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.504993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:29.510575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:29.513197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:29.514163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 305/632] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:29.516373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:29.518233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:29.519954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:29.564977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:29.638960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 328/633] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:29.639860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:29.647484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667886-65c0-4ca7-96dc-f16d9f4f66bd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.682834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.683524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.683827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.684109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/b99893144ac74cc9aec6d197c3dc1bc9/roles/e5d4d76180364a138e4c8c41652caa4d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.684685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:29.698789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=b99893144ac74cc9aec6d197c3dc1bc9, role_id=e5d4d76180364a138e4c8c41652caa4d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:29.700824 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:29.740163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda9e23-2860-4cec-88b5-88416381154d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.774937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b18b13-f0ad-42bf-b71c-c0dfdcd5f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.775756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 306/634] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:29 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/b99893144ac74cc9aec6d197c3dc1bc9/roles/e5d4d76180364a138e4c8c41652caa4d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:13:29.775887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18b13-f0ad-42bf-b71c-c0dfdcd5f536 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.775887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18b13-f0ad-42bf-b71c-c0dfdcd5f536 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.776095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b18b13-f0ad-42bf-b71c-c0dfdcd5f536 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.776805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:29.801271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b18b13-f0ad-42bf-b71c-c0dfdcd5f536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-34b18b13-f0ad-42bf-b71c-c0dfdcd5f536 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:29.809607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:29.810631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 329/635] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:29.814257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d620e6-7aac-45b5-a78d-f2df218b8555 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.815054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d620e6-7aac-45b5-a78d-f2df218b8555 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.815054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d620e6-7aac-45b5-a78d-f2df218b8555 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.816693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 330/636] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:29.817944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d620e6-7aac-45b5-a78d-f2df218b8555 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:29.897940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:29.918803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a3379-22b9-4d80-aac1-f16affacb2bd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.957209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d620e6-7aac-45b5-a78d-f2df218b8555 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:29.959006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:29.966719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:29.966719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:29.966719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:29.967213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:29.967615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:29.967759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:29.969139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:29.979287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 307/637] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:29.981448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.001093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2955db3-0676-437c-bc74-9a143d0bead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.002576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955db3-0676-437c-bc74-9a143d0bead0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.003385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955db3-0676-437c-bc74-9a143d0bead0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.004137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2955db3-0676-437c-bc74-9a143d0bead0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.018657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2955db3-0676-437c-bc74-9a143d0bead0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.020330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2955db3-0676-437c-bc74-9a143d0bead0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c2955db3-0676-437c-bc74-9a143d0bead0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:30.040846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:30.042046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:30.043382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:30.043382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:30.043382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:30.044257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 331/638] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:30.049101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aed28-b109-428a-ab5e-5c6eb968fdc5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.049101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aed28-b109-428a-ab5e-5c6eb968fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.049101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931aed28-b109-428a-ab5e-5c6eb968fdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.072462 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-931aed28-b109-428a-ab5e-5c6eb968fdc5 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:30.073789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-931aed28-b109-428a-ab5e-5c6eb968fdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:30.118371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943dbf-77df-4296-a735-7af6360d7f75 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.148769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 332/639] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:30.150005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aed28-b109-428a-ab5e-5c6eb968fdc5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.173436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.174258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.174545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.174816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.175752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:30.176068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.177545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.192949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 308/640] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:30.193803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.208628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:30.275859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:30.297850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931aed28-b109-428a-ab5e-5c6eb968fdc5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.321987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47078b-0b75-4d02-8003-b3075445450d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.349028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.350587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.351189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.352385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.362340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.362960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.363243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.363552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.364261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:30.364638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.366043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.368124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.370426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.379920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 309/641] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:30.380840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:30.392116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:30.393121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:30.393991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:30.393991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:30.393991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:30.396932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 333/642] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:30.398297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.488626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:30.526086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97f811-2d58-4a1a-bf06-c031e865c64f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.544799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0dc8b-e01a-4e3b-a545-c2479576f7a5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.563550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.564097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.564383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.564659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.577669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.579170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.587325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.588333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.588788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.589226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.592965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:30.595186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:30.596199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:30.597664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:30.597664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:30.597664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:30.599562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.601638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 310/643] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:30.601767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.601952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:30.615929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:30.616891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 334/644] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:30.617970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.728737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c43138-c53c-4a67-ad87-f7411dab4075 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.735460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0102d-b311-4d10-abc6-42444747fccc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.752995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:30.765459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.766075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.766353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.766625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.769718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:30.769718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.769718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.773032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.773727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.773979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.774247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.785972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 311/645] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:30.785972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.790571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:30.797886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:30.798855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 335/646] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:30.799759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.875002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:30.903317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfec9f-c443-4ae3-84e5-63dd78e03414 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.924671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276f13c-408a-4bab-ad4d-7bb490de13cd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:30.940012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.940684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.941023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.941298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.942125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:30.942435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.944437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.956973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 312/647] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:30.957613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:30.967180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:30.968133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:30.968416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:30.968859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:30.969611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:30.969968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:30.971334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:30.991275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 336/648] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:30.991275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.009458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:31.076580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4de778-019e-4bf2-96f3-0663e98fa460 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.106072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e615c-70ae-4442-b89e-740dc71c9e03 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.120278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.120988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.121897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.122249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.126529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:31.130779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.132269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:31.144485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:31.152134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:13:31.153111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:31.153646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.153736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 313/649] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:31.153820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.153820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.153820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.154016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.154084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:31.154084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.154084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.157317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 337/650] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:31.162727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.268439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f5e5-57e6-4fab-93f1-0ff77199eac3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.270908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:31.271886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c86b8-c01b-4555-9109-8c01ca335b2f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.310951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.312213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.312494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.312773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.317364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.317976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.318254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.318525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.319262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=952c5c9a37a54497aab20652d0282690) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:31.319602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.321038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.321231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.322673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.328174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 338/651] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/role_assignments?user.id=952c5c9a37a54497aab20652d0282690&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:31.328820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:31.361092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:31.362085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:31.362989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 314/652] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:31.363636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.399613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:31.470457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23c3a6-75ed-49e7-b4e4-194a62e2ba2a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.522682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.523301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.523683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.523899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.524650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:31.524956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.526646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.543077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e5a8-477c-4ea6-b57a-19b434529f8f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.548550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 339/653] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:31.549524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.592119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.592861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.593059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.593354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.607110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.608663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:31.625696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:31.626688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:31.627568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:31.627568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:31.627568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:31.627568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 315/654] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:31.627806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.648473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:31.669102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:31.674366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220fa68-ed55-476e-866e-9194c541be6a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.729343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.729960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.730234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.731017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.731832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:31.732138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.733587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.757317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 340/655] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:31.758319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.814000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25553bf-58ad-49ca-9e3c-52fa7ed1c343 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.876848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.877149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17264f03-aeb9-4ff5-8489-5878439d7948 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:31.877476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.877745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.878017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.923643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:31.924165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:31.924441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:31.927372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:31.927372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:31.927372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.928552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.946649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 341/656] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:31.947687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:31.964521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:31.966729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:31.979996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:31.985672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:32.085366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 316/657] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:32.086245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:32.088463 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ac71-01fa-4e35-b808-1cfd64e02076 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:32.135930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c913-aba6-4df4-b8eb-f6def4e2ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:32.138947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c913-aba6-4df4-b8eb-f6def4e2ae00 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.139084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c913-aba6-4df4-b8eb-f6def4e2ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.139331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c913-aba6-4df4-b8eb-f6def4e2ae00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.206630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bba1d-1e36-4ac8-96d4-08d00294be0d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:32.224453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:32.227558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c913-aba6-4df4-b8eb-f6def4e2ae00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:32.229037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c913-aba6-4df4-b8eb-f6def4e2ae00 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:32.249471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:32.259625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:32.261227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.261764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.263238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.272352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:32.273837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:32.292602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:32.294561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:32.295733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 317/658] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:32.296846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:32.364689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 342/659] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:32.366418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7918fdc-02bf-48a3-af5c-a294b48d1e59 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.366758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7918fdc-02bf-48a3-af5c-a294b48d1e59 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.367092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7918fdc-02bf-48a3-af5c-a294b48d1e59 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.368588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 343/660] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:32.373439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7918fdc-02bf-48a3-af5c-a294b48d1e59 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:32.428511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6134e9f-1d15-4de5-a6cf-984c37469fa3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:32.473234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:32.473797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.474074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.474498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.487567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:32.489077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:32.505879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:32.508598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:32.509706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:32.509706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:32.509706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:32.509706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 318/661] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:32.509706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:32.514503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7918fdc-02bf-48a3-af5c-a294b48d1e59 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:32.536319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:32.546562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:32.558103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65540ee9-e0bc-44c7-8d9e-19be290215f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:32.558857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540ee9-e0bc-44c7-8d9e-19be290215f2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.559259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540ee9-e0bc-44c7-8d9e-19be290215f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.559636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540ee9-e0bc-44c7-8d9e-19be290215f2 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.560394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65540ee9-e0bc-44c7-8d9e-19be290215f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:32.560704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65540ee9-e0bc-44c7-8d9e-19be290215f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:32.562157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65540ee9-e0bc-44c7-8d9e-19be290215f2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:32.583706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 344/662] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Sep 26 12:13:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:32.589372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679590c-b8d2-449f-a97f-cca51b0bf587 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.589674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679590c-b8d2-449f-a97f-cca51b0bf587 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.590543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679590c-b8d2-449f-a97f-cca51b0bf587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.611365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9679590c-b8d2-449f-a97f-cca51b0bf587 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:32.612647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9679590c-b8d2-449f-a97f-cca51b0bf587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:32.636397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdf1cc-e974-4f06-8fe1-ef0ea31bba94 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:32.679627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:32.680623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.681114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.681570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.693420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:32.695135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:32.711460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:32.712460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:32.713317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:32.713317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:32.713317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:32.713317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 319/663] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:32.713559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:32.722195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 345/664] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:32.723459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679590c-b8d2-449f-a97f-cca51b0bf587 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:32.832912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:32.854921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679590c-b8d2-449f-a97f-cca51b0bf587 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:32.862488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1431-8f9d-4836-bf8a-cac09ffe8909 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:32.863632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:32.897577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:32.898195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.898473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.898745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.903555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:32.904470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:32.905035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:32.905501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:32.906381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:32.906899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:32.908530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:32.927007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 320/665] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:32.928276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:32.977661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:32.979072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.045976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4404ba-92fe-4be2-be3a-07f5bba0d6f1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.093977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.094688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.094975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.095318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.095918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:33.096219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.097611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.104458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 346/666] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:33.104458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.105348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:33.110963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 321/667] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:33.111662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.114904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:33.225201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b12c2a-d175-4722-bc31-ae10342c7b38 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.250391 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1235-f3e2-486b-8f29-5a0effae3275 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.266024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.266679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.266954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.267220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.274567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.276046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:33.288931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:33.290097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:33.291586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 347/668] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:33.293673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.295251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.295251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.295251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.296442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.308756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:33.314604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:33.316323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 322/669] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:33.318999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.381491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:33.393068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:33.430551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1f964-ce62-4137-8342-126bc812f388 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.431013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9063b-7505-4cb2-b242-5e7aa8966afa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.468647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.469182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.469401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.469546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.469824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.469982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.470124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.470446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.478087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.479583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.483130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.484958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:33.492875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:33.494004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 323/670] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:33.495807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:33.507167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:33.514541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:33.516130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:33.516130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:33.516130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:33.516130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 348/671] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:33.516130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.620150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ff380-ebaa-4a24-8ab5-d090ddd1d39a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.633905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301ee3a-f312-4474-8f3a-2a4fa4cefdf1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.640447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:33.653589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:33.661075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.661508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.661845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.662132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.662828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:33.663217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.664607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.672557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.673709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.673984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.674251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.675431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:33.675741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.677126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.678728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 324/672] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:33.679580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.698118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 349/673] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:33.698118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.799500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e08a76-9981-4489-895a-74c04100ac92 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.818080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45353881-785f-407f-a9df-354c2fe112d2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:33.854585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.855225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.855678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.856007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.856725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:33.857023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.858728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.869252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:33.870190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:33.870321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:33.870683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:33.871758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:33.872278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:33.874054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 325/674] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:33.874180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:33.876378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.890741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 350/675] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:33.892698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:33.923883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:33.943137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:34.000887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135809b0-0a4a-4f42-bdd5-8ab502d06c17 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.017991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502bd33-a318-478f-90b6-44ca114eee84 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.039011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.039788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.040079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.040345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.042805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=91af8e7c2dcd41e480e1b1a086ba2688) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:34.043681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.045235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.052276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 326/676] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/role_assignments?user.id=91af8e7c2dcd41e480e1b1a086ba2688&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:34.053177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.062937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.063596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.063976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.064254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.077522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.079061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:34.097105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:34.098794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:34.101033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:34.101033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:34.101033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:34.101033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 351/677] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:34.101033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.213808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8527d8d-f1a2-40bb-bda4-d289c16cb83c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.216410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:34.235320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:34.255764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390066e6-fb24-4bb4-96dd-24dd065879da None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.261423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc462d15-9854-4362-8e87-a96723b62722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.262422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462d15-9854-4362-8e87-a96723b62722 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.262701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462d15-9854-4362-8e87-a96723b62722 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.262982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc462d15-9854-4362-8e87-a96723b62722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.263750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc462d15-9854-4362-8e87-a96723b62722 None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=957e46599f5d4d21b822e8c9ce1480b6) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:34.264062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc462d15-9854-4362-8e87-a96723b62722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.265533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc462d15-9854-4362-8e87-a96723b62722 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.273219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 327/678] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/role_assignments?user.id=957e46599f5d4d21b822e8c9ce1480b6&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:34.274639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de32e9-0cde-4b5f-8f9b-877685fe2194 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.274933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de32e9-0cde-4b5f-8f9b-877685fe2194 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.275206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de32e9-0cde-4b5f-8f9b-877685fe2194 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.276764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 328/679] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:34.281963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de32e9-0cde-4b5f-8f9b-877685fe2194 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.318392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada09b43-03c2-4cf3-9d80-4d95cf486cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.318946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09b43-03c2-4cf3-9d80-4d95cf486cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.319220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09b43-03c2-4cf3-9d80-4d95cf486cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.319539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada09b43-03c2-4cf3-9d80-4d95cf486cd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.329217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada09b43-03c2-4cf3-9d80-4d95cf486cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.330710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada09b43-03c2-4cf3-9d80-4d95cf486cd2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ada09b43-03c2-4cf3-9d80-4d95cf486cd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:34.353443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:34.357876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:34.358980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 352/680] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:34.362304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4e632-0bd8-453d-945f-7842bc7b0e7d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.362588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4e632-0bd8-453d-945f-7842bc7b0e7d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.362859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4e632-0bd8-453d-945f-7842bc7b0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.385336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c1a4e632-0bd8-453d-945f-7842bc7b0e7d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:34.386582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c1a4e632-0bd8-453d-945f-7842bc7b0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:34.455064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de32e9-0cde-4b5f-8f9b-877685fe2194 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.492697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 353/681] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:34.493806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4e632-0bd8-453d-945f-7842bc7b0e7d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.504998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.505985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.506503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.506782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.507791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:34.508102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.509655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.530354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 329/682] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:34.536242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.571403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:34.623416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:34.644611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4e632-0bd8-453d-945f-7842bc7b0e7d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.678257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0453a-be62-432c-a2cd-fdff220fa9bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.688003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.688623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.688903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.689180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.690014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:34.690329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.691829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.707372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 354/683] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:34.713299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.748120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.748779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.749061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.749335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.761231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.763275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:34.780899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:34.781911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:34.782818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:34.783334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 330/684] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:34.791479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.849418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d71d5-2a8f-4560-9287-48f951cbdef6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.894812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:34.895686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:34.896063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:34.896343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:34.897422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=5c06385b20074363b3a5f7216947280b) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:34.897599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:34.898111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:34.899495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:34.915521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 355/685] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/role_assignments?user.id=5c06385b20074363b3a5f7216947280b&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:34.916580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:34.926227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d12c-730f-4bf8-a0a5-337d54192462 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:34.939992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:35.020346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:35.020972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:35.021249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:35.021517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:35.022263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:35.022562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:35.024103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:35.059092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 331/686] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:35.066280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:35.142839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e1a1-17e8-42da-a1cc-70e332b76e7a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:35.182727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:35.183409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:35.183767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:35.184044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:35.196312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:35.203066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:35.205776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:35.207817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 356/687] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:35.213597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:35.216375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb119b-4ecd-4023-a27e-b99d31b9fe28 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:35.263656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:35.264703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:35.265191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:35.265673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:35.293791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:35.297660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:35.338016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9526c4c-745e-4e7a-b9f1-7bd8a1a1b101 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:35.366073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:35.367556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:35.387922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:35.389020 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:35.389446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:35.389947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:35.390780 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:35.391245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:35.392835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:35.403001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 357/688] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:35.409380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:35.506526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 332/689] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:35.508054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:35.526376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcf45-69ad-4d2e-b962-51d6ccc39483 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:35.557247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:35.571488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:35.577045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:35.577892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:35.578340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:35.578768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:35.603480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:35.608935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:35.623744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf70bf-6965-46c8-a407-dc0c51b248bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:35.631473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:35.632944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:35.634010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:35.634010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:35.634010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:35.645041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 358/690] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:35.650949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:35.668003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:35.668003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:35.668003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:35.668003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:35.683405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:35.683405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:35.697289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:35.698269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:35.699850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:35.699850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:35.699850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:35.706792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 333/691] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:35.709042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:35.826513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf54f2-8ecd-4cbd-976e-08a57e125844 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:35.835843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:35.867141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:35.868213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:35.868864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:35.875186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:35.875186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:35.875186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:35.875186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:35.891696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 334/692] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:35.894657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:35.989555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a69e-f80d-4638-90da-6f1928397063 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:36.006243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf4948-9021-4042-a15d-8949998be270 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:36.044082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:36.044728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.045221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.045340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.052653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:36.059248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:36.068060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:36.069752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.070240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.070779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.071768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:36.072312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:36.072989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:36.073840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:36.080285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 335/693] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:36.082013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:36.092399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:36.097378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 359/694] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:36.102737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:36.150811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:36.155208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:36.220967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf913280-9970-4f17-8af3-cc1233844168 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:36.259084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:36.260152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.260678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.261274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.271630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:36.273500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:36.288716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:36.289828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:36.290835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:36.294226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 360/695] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:13:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:36.299941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:36.309998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a683cad-40ba-43b1-852d-91e5599c441b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:36.404133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:36.404797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.405086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.405467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.406074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:36.406382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:36.407967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:36.430784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 336/696] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:36.436440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:36.445847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:36.450141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8799-3b77-4c81-8d32-5544840a064f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:36.489600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:36.490838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.491452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.491986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.493045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:36.493940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:36.497531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:36.520885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 361/697] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:13:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:36.530004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:36.662281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:36.666939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8fb89-1a6a-46da-938b-31404e7b943b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:36.714637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d147d-76fd-4f54-8a3c-5d3998f53383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:36.716586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d147d-76fd-4f54-8a3c-5d3998f53383 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.717177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d147d-76fd-4f54-8a3c-5d3998f53383 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.718579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d147d-76fd-4f54-8a3c-5d3998f53383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.741125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf3d5e-5fd0-4c21-a43b-e21f9371a05e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:36.776378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:36.807123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350aaba-f3d9-444c-96ad-a2946a080ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:36.807793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350aaba-f3d9-444c-96ad-a2946a080ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.808076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350aaba-f3d9-444c-96ad-a2946a080ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.808348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350aaba-f3d9-444c-96ad-a2946a080ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.809842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350aaba-f3d9-444c-96ad-a2946a080ce0 None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=b99893144ac74cc9aec6d197c3dc1bc9) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:36.810151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350aaba-f3d9-444c-96ad-a2946a080ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:36.812004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350aaba-f3d9-444c-96ad-a2946a080ce0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:36.820913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 337/698] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:36 2022] GET /identity/v3/role_assignments?user.id=b99893144ac74cc9aec6d197c3dc1bc9&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 608 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:36.823321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e01a92-fa5c-45c3-8f7a-11a89c2be0ca None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.823645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e01a92-fa5c-45c3-8f7a-11a89c2be0ca None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.824110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e01a92-fa5c-45c3-8f7a-11a89c2be0ca None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.830875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 338/699] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:36.832392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94dcd3-c243-4228-9f5c-dbf3dbe7fb21 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:36.832681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94dcd3-c243-4228-9f5c-dbf3dbe7fb21 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:36.832956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94dcd3-c243-4228-9f5c-dbf3dbe7fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:36.836282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d147d-76fd-4f54-8a3c-5d3998f53383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:36.838369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d147d-76fd-4f54-8a3c-5d3998f53383 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:36.856625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3e94dcd3-c243-4228-9f5c-dbf3dbe7fb21 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:36.858266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3e94dcd3-c243-4228-9f5c-dbf3dbe7fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:36.959857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 339/700] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:36.996973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 362/701] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:37.004628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94dcd3-c243-4228-9f5c-dbf3dbe7fb21 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:37.118661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:37.161945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94dcd3-c243-4228-9f5c-dbf3dbe7fb21 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:37.208381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:37.209037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.209321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.209595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.222891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:37.224389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:37.238376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636f01-9548-44fd-a537-0cb49a823f19 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.239007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636f01-9548-44fd-a537-0cb49a823f19 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.239508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636f01-9548-44fd-a537-0cb49a823f19 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.241072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 363/702] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:37.244816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:37.246092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:37.247714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:37.247714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:37.247714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:37.247714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 340/703] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:37.247982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3aa9e-209e-488f-8fd2-116bbc8f2659 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.247982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3aa9e-209e-488f-8fd2-116bbc8f2659 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.247982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3aa9e-209e-488f-8fd2-116bbc8f2659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.250569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:37.273572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-61a3aa9e-209e-488f-8fd2-116bbc8f2659 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:37.275248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-61a3aa9e-209e-488f-8fd2-116bbc8f2659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:37.358105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:37.374572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 364/704] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:13:37.375562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3aa9e-209e-488f-8fd2-116bbc8f2659 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:37.414033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efc63-5bc2-4670-8b28-cc6ee55dc48e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:37.462509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:37.495373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:37.496668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.497029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.497435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.498161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:37.498576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:37.500153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:37.526723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 341/705] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:37.536368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:37.541000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3aa9e-209e-488f-8fd2-116bbc8f2659 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:37.583136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:37.584082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.584499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.584902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.585622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:37.587259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:37.599117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:37.600472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:37.601524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:37.604228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 365/706] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Sep 26 12:13:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:37.610538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:37.671186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:37.727148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357a727-e6b7-4614-b59a-a9597289f18a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:37.732583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e7d6d-99a0-4423-ac83-75994c589420 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:37.779959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:37.780850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.781276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.781694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.782580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:37.783657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.784202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.784724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.785887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:37.786442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:37.788947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:37.790550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:37.792593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:37.798669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 366/707] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Sep 26 12:13:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:37.798669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:37.810933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:37.811948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:37.812819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:37.819678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 342/708] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:37.821034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:37.884555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:37.914807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a86d9-aed5-4a9c-bab9-556c9a0443b9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:37.936069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:37.956999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:37.958706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:37.959494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:37.960387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:37.980038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:37.986599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:38.001877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b4fc-9f8f-4baa-8a62-51cfb343be14 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:38.005620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:38.006801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:38.007731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:38.007731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:38.007731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:38.012300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 367/709] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:38.013621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:38.166692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:38.167583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.168116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.168598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.169630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:38.170159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:38.172511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:38.175589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed0391-a76d-4493-944b-0c90cec34d86 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:38.187390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 343/710] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Sep 26 12:13:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:38.187390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:38.226594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb4b3c-8a5a-4c5b-a5e6-594c510cb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:38.227226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4b3c-8a5a-4c5b-a5e6-594c510cb3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.227544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4b3c-8a5a-4c5b-a5e6-594c510cb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.227823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4b3c-8a5a-4c5b-a5e6-594c510cb3d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.228537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb4b3c-8a5a-4c5b-a5e6-594c510cb3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:38.228845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb4b3c-8a5a-4c5b-a5e6-594c510cb3d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:38.230969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb4b3c-8a5a-4c5b-a5e6-594c510cb3d3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:38.245832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 368/711] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:38.246993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34662533-9f5b-48c0-bf3b-a7c7fbb5fda9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.247335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34662533-9f5b-48c0-bf3b-a7c7fbb5fda9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.247675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34662533-9f5b-48c0-bf3b-a7c7fbb5fda9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.253189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 369/712] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:38.254925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33ee5c-7966-41f5-a868-78a34e84e375 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.255205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33ee5c-7966-41f5-a868-78a34e84e375 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.255530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33ee5c-7966-41f5-a868-78a34e84e375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.277883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3f33ee5c-7966-41f5-a868-78a34e84e375 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:38.279249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3f33ee5c-7966-41f5-a868-78a34e84e375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:38.312395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:38.339220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba884-31c4-4291-8df8-ab3d6469daaa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:38.351722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:38.368089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 370/713] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:38.369279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33ee5c-7966-41f5-a868-78a34e84e375 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:38.408323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:38.408959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.409239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.409510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.410164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:38.410463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:38.411908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:38.441933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 344/714] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:38.448400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:38.549530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33ee5c-7966-41f5-a868-78a34e84e375 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:38.617957 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:38.618582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.618870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.619205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.620060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=952c5c9a37a54497aab20652d0282690) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:38.620373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:38.622542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:38.629459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 371/715] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:38 2022] GET /identity/v3/role_assignments?user.id=952c5c9a37a54497aab20652d0282690&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:38.645984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d58adb-10bc-470f-bb18-87e35c742602 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:38.687423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:38.688505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.688996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.689553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.690458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:38.692271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:38.709318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:38.741463 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:38.794584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 345/716] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:13:38 2022] POST /identity/v3/users => generated 254 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:38.843905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f73e1-15d7-4008-9866-16044eb13cab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:38.885991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:38.887332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:38.887663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:38.887943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] PATH_INFO: `/v3/services/network` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:38.888547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:38.890016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:38.900754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:38.901803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:38.903970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 372/717] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:38 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:38.908699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:38.954720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:39.087855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e04f-4d2c-4c7d-8419-850de2a836b0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:39.141339 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff22e2b-f612-45a2-8789-df9db9b43f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:39.142140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22e2b-f612-45a2-8789-df9db9b43f6f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:39.142458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22e2b-f612-45a2-8789-df9db9b43f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:39.142820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff22e2b-f612-45a2-8789-df9db9b43f6f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:39.143625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff22e2b-f612-45a2-8789-df9db9b43f6f None admin] RBAC: Adding query filter params (name=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:39.144011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff22e2b-f612-45a2-8789-df9db9b43f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:39.145503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff22e2b-f612-45a2-8789-df9db9b43f6f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:39.153835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 346/718] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:13:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:39.160062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:39.255705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:39.274414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a74d9-c7c7-429f-b273-6498028a5c07 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:39.315307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138c79d-c4d3-469b-8920-2a954eff62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:39.315939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138c79d-c4d3-469b-8920-2a954eff62f8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:39.316214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138c79d-c4d3-469b-8920-2a954eff62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:39.316538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138c79d-c4d3-469b-8920-2a954eff62f8 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:39.317175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138c79d-c4d3-469b-8920-2a954eff62f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:39.317473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138c79d-c4d3-469b-8920-2a954eff62f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:39.318829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138c79d-c4d3-469b-8920-2a954eff62f8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:39.325287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 373/719] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:13:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:39.689970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c905a5-16fe-4e68-bf8a-4a6a2b18151b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:39.690493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c905a5-16fe-4e68-bf8a-4a6a2b18151b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:39.690493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c905a5-16fe-4e68-bf8a-4a6a2b18151b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:39.692112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 347/720] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:39.697622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da207-fa37-4a6a-9ba3-8f96a85d19bb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:39.697973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da207-fa37-4a6a-9ba3-8f96a85d19bb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:39.698251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da207-fa37-4a6a-9ba3-8f96a85d19bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:39.724582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4a3da207-fa37-4a6a-9ba3-8f96a85d19bb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:39.725824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4a3da207-fa37-4a6a-9ba3-8f96a85d19bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:39.822376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 374/721] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:40.287144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c905a5-16fe-4e68-bf8a-4a6a2b18151b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:40.456459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:40.474911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c905a5-16fe-4e68-bf8a-4a6a2b18151b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:40.521786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:40.522805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:40.523224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:40.523632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:40.536866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:40.541874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:40.550214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:40.551691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 348/722] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:40.555787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3da207-fa37-4a6a-9ba3-8f96a85d19bb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:40.681505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:40.703634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3da207-fa37-4a6a-9ba3-8f96a85d19bb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:40.739411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726a74e-a366-43d4-b0c7-2548174dd138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:40.740015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726a74e-a366-43d4-b0c7-2548174dd138 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:40.740221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726a74e-a366-43d4-b0c7-2548174dd138 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:40.740493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726a74e-a366-43d4-b0c7-2548174dd138 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:40.741161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726a74e-a366-43d4-b0c7-2548174dd138 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:40.741460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726a74e-a366-43d4-b0c7-2548174dd138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:40.742826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726a74e-a366-43d4-b0c7-2548174dd138 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:40.751689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 375/723] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:40.756979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:40.895619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b999be-eb46-464b-beb7-938853f3e6a3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:40.909358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36efad6-f419-4159-ba1b-d78fe0ec1c90 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:40.909697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36efad6-f419-4159-ba1b-d78fe0ec1c90 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:40.909915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36efad6-f419-4159-ba1b-d78fe0ec1c90 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:40.912604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 376/724] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:13:40.916737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29aae2-1a1d-44cf-888f-96f6792bfc17 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:40.917021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29aae2-1a1d-44cf-888f-96f6792bfc17 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:40.917302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29aae2-1a1d-44cf-888f-96f6792bfc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:40.936734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1b29aae2-1a1d-44cf-888f-96f6792bfc17 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:40.938046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1b29aae2-1a1d-44cf-888f-96f6792bfc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:40.942007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:40.942917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:40.943418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:40.943906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:40.961459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:40.962932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:40.970710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:40.989210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:40.990260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:40.991180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:40.991180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:40.991180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:40.991180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 349/725] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:40.996940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:41.016383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 377/726] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:13:41.120071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92497859-2caf-4c22-86a5-7dad8c62ac09 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:41.164412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:41.165032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:41.165315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:41.165588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:41.166236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:41.166538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:41.167973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:41.185096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 350/727] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:41.190954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29aae2-1a1d-44cf-888f-96f6792bfc17 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:41.307858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:41.343716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29aae2-1a1d-44cf-888f-96f6792bfc17 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:41.372445 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:41.384427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:41.385077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:41.385362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:41.385640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:41.394199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:41.395849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:41.409833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:41.410981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:41.412068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:41.415484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 378/728] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:41.417581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:41.479388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:41.542568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005865b-878a-4a4d-9014-3bb0fe03ea35 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:41.544057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca816374-f7fc-4337-bcf7-5079c663321a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:41.583711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64286771-f53c-4d36-af36-ccd8759f588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:41.584697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286771-f53c-4d36-af36-ccd8759f588c None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:41.585197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286771-f53c-4d36-af36-ccd8759f588c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:41.585734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64286771-f53c-4d36-af36-ccd8759f588c None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:41.586370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:41.587938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286771-f53c-4d36-af36-ccd8759f588c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:41.589912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64286771-f53c-4d36-af36-ccd8759f588c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:41.592533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798a50e-9255-49a5-9a9d-ac2deb2abb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:41.592533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798a50e-9255-49a5-9a9d-ac2deb2abb6b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:41.594884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798a50e-9255-49a5-9a9d-ac2deb2abb6b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:41.594884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798a50e-9255-49a5-9a9d-ac2deb2abb6b None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:41.594884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798a50e-9255-49a5-9a9d-ac2deb2abb6b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:41.594884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798a50e-9255-49a5-9a9d-ac2deb2abb6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:41.595639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798a50e-9255-49a5-9a9d-ac2deb2abb6b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:41.615858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 379/729] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Sep 26 12:13:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:41.617031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f2c4-c69d-42ed-8417-9506b1a689f9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:41.617317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f2c4-c69d-42ed-8417-9506b1a689f9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:41.617590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f2c4-c69d-42ed-8417-9506b1a689f9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:41.618906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 380/730] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:41.624054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f2c4-c69d-42ed-8417-9506b1a689f9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:41.674668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 351/731] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:13:41 2022] POST /identity/v3/services => generated 251 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:41.676685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040eef-c8a1-46a4-bf46-b03fcbe0a54f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:41.677222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040eef-c8a1-46a4-bf46-b03fcbe0a54f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:41.677811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040eef-c8a1-46a4-bf46-b03fcbe0a54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:41.716819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-df040eef-c8a1-46a4-bf46-b03fcbe0a54f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:41.718045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-df040eef-c8a1-46a4-bf46-b03fcbe0a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:41.851745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 352/732] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:41.857000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f2c4-c69d-42ed-8417-9506b1a689f9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:41.894811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:41.895802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:41.896082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:41.896356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:41.959742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:41.975399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:41.978829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:42.104889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe274a-e9bc-4d66-860f-b271c2dc87f5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.105071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe274a-e9bc-4d66-860f-b271c2dc87f5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.106055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe274a-e9bc-4d66-860f-b271c2dc87f5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.107598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 353/733] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:42.113581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd6b6-771a-4ccc-937b-0147ff96863d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.114275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd6b6-771a-4ccc-937b-0147ff96863d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.114870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd6b6-771a-4ccc-937b-0147ff96863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.131960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 381/734] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:41 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 12:13:42.133302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:42.147753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-423cd6b6-771a-4ccc-937b-0147ff96863d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:42.149295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-423cd6b6-771a-4ccc-937b-0147ff96863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:42.221117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:42.258629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 354/735] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 12:13:42.267367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd6b6-771a-4ccc-937b-0147ff96863d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:42.267580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:42.284950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598aa03-a0c3-427b-8c02-b80baec60155 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:42.323362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c00e80-0b0f-421a-8622-1ecb116565dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:42.324115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c00e80-0b0f-421a-8622-1ecb116565dd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.324582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c00e80-0b0f-421a-8622-1ecb116565dd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.325050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c00e80-0b0f-421a-8622-1ecb116565dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.335690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c00e80-0b0f-421a-8622-1ecb116565dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:42.337264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c00e80-0b0f-421a-8622-1ecb116565dd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-48c00e80-0b0f-421a-8622-1ecb116565dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:42.354162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:42.355879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:42.356973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:42.356973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:42.356973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:42.360810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 382/736] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:42.362219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a66968-1535-4642-95eb-eeaf09d33fa6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.362500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a66968-1535-4642-95eb-eeaf09d33fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.362836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a66968-1535-4642-95eb-eeaf09d33fa6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.364842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 383/737] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:42.365611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a66968-1535-4642-95eb-eeaf09d33fa6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:42.381465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd6b6-771a-4ccc-937b-0147ff96863d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:42.421353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8debb0-f5dc-4e8e-8766-c7ad60d604c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:42.421991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8debb0-f5dc-4e8e-8766-c7ad60d604c4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.422266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8debb0-f5dc-4e8e-8766-c7ad60d604c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.422632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8debb0-f5dc-4e8e-8766-c7ad60d604c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.434197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8debb0-f5dc-4e8e-8766-c7ad60d604c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7e8debb0-f5dc-4e8e-8766-c7ad60d604c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:42.439852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:42.441561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:42.442387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 355/738] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:42.443289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103ef8-bef6-4578-8f0f-9c9d926e39fb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.443289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103ef8-bef6-4578-8f0f-9c9d926e39fb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.444055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58103ef8-bef6-4578-8f0f-9c9d926e39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.468317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-58103ef8-bef6-4578-8f0f-9c9d926e39fb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:42.470637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-58103ef8-bef6-4578-8f0f-9c9d926e39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:42.490292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a66968-1535-4642-95eb-eeaf09d33fa6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:42.523781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:42.533317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:42.547899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.547899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.547899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.547899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:42.547899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:42.547899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:42.548507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:42.552270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 384/739] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:42.554359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:42.572388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 356/740] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 12:13:42.573340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58103ef8-bef6-4578-8f0f-9c9d926e39fb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:42.680418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b301-d9f5-45ef-8801-723dac314899 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:42.708756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58103ef8-bef6-4578-8f0f-9c9d926e39fb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:42.722841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:42.723555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.723835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.724106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.724778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:42.725084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:42.727065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:42.738503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 385/741] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:42.739603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:42.763876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:42.764649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.765000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.765346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.766232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:42.767966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:42.829293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:42.862438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 357/742] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:13:42 2022] POST /identity/v3/services => generated 240 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:42.863453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:42.890854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b11f9f-562d-437e-a0d2-1c5ea721643a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:42.904047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:42.941972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:42.942515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:42.942883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:42.943159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:42.951911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:42.953494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:42.966314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:42.967488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:42.968397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 386/743] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:42.969291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.031591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490da5a7-d98c-4ef2-a031-d2f6b26ed557 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.094698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.095667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.096093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.096493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.110600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652d8b6-c72b-4cc8-b0cf-8f1935dc875a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.111131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:43.113098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:43.129320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:43.135444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:43.137375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:43.138451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:43.138451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:43.138451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:43.140023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 358/744] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:43.143506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.159377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.159377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.159377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.159377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.175473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:43.182160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:43.183303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 387/745] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:43.184801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.242746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:43.273719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d11181-8cd7-42c5-af29-6e6721867cec None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.314171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.314930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.315270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.315639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6d4a-8531-42eb-8343-ed19c5546970 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.315746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.316415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:43.316787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:43.318304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:43.332076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 359/746] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:43.333101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.356344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.356966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.357247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.357522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.358180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:43.358486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:43.360254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:43.377351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 388/747] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:43.378373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.420812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:43.477996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bf266-177c-455c-9c0a-0383191ec940 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.505558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deca50-67a5-4455-8caf-505dcb86164a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.528776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.530068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.530567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.531489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.532421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:43.533017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:43.535314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:43.538569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:43.554712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 360/748] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:43.554712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.566774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.568002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.568495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.568973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.569932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=b99893144ac74cc9aec6d197c3dc1bc9) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:43.570451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:43.572193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:43.580740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 389/749] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/role_assignments?user.id=b99893144ac74cc9aec6d197c3dc1bc9&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:43.582034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.694509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ab4f3-09cf-47f1-9b60-01614e1010fb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.713832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:43.718595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad25e61-b177-4e12-86e5-c11bffc5b522 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:43.744205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18348a30-348d-4406-80b2-735f84815275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.744862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348a30-348d-4406-80b2-735f84815275 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.745324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348a30-348d-4406-80b2-735f84815275 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.745420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348a30-348d-4406-80b2-735f84815275 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.767424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18348a30-348d-4406-80b2-735f84815275 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:43.767424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18348a30-348d-4406-80b2-735f84815275 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:43.769734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:43.770388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:43.770665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:43.770929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-18348a30-348d-4406-80b2-735f84815275 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:43.784553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:43.785563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:43.786482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 361/750] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:43.796901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:43.798417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:43.800142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18348a30-348d-4406-80b2-735f84815275 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:43.823616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:43.825335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:43.826223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:43.826223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:43.826223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:43.832061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 390/751] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:43.833627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:43.945793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:44.011005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c5cb2-3435-4c34-a638-81cab78e6771 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.045743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18348a30-348d-4406-80b2-735f84815275 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.055888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.056502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.056779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.057109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.057765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:44.058065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:44.062711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:44.095586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 391/752] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:44.100371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:44.116642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:44.125087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.131237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.131237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.131237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.131237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:44.131237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:44.131237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:44.169203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 362/753] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:13:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:44.174795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:44.279857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4cde-c6e8-41b8-9c59-d1c515e00745 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.341744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.342363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.342642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.343454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.364088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:44.365560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:44.373891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aac88c-95bb-4748-9d0c-d443a7748f2e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:44.388512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:44.389533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:44.390454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 392/754] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:13:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:44.397741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:44.411774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:44.432631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e36b74-7879-4222-a24d-4b379be32287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.433823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36b74-7879-4222-a24d-4b379be32287 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.434622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36b74-7879-4222-a24d-4b379be32287 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.435461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36b74-7879-4222-a24d-4b379be32287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.450527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e36b74-7879-4222-a24d-4b379be32287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:44.452035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e36b74-7879-4222-a24d-4b379be32287 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-62e36b74-7879-4222-a24d-4b379be32287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:44.474508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:44.476472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:44.478258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:44.478258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:44.478258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:44.478258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 363/755] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:44.478258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d0dc-7b43-4a77-b1f8-d4a7550e095a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.478707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d0dc-7b43-4a77-b1f8-d4a7550e095a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.478707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d0dc-7b43-4a77-b1f8-d4a7550e095a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.485757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 364/756] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:44.486158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d0dc-7b43-4a77-b1f8-d4a7550e095a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:44.500545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:44.540262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947caca4-31da-4761-98be-2465b5cc943e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.586661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a3fb1-d31c-4bab-a620-299afe5f1fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.587279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3fb1-d31c-4bab-a620-299afe5f1fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.587663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3fb1-d31c-4bab-a620-299afe5f1fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.587998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3fb1-d31c-4bab-a620-299afe5f1fb2 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.588743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a3fb1-d31c-4bab-a620-299afe5f1fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:44.589047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a3fb1-d31c-4bab-a620-299afe5f1fb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:44.590829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a3fb1-d31c-4bab-a620-299afe5f1fb2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:44.619195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 393/757] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Sep 26 12:13:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:44.620617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8e73-025b-4d81-b13d-1ce9331c43b0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.621638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8e73-025b-4d81-b13d-1ce9331c43b0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.621932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8e73-025b-4d81-b13d-1ce9331c43b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.647532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-731b8e73-025b-4d81-b13d-1ce9331c43b0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:44.649132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-731b8e73-025b-4d81-b13d-1ce9331c43b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:44.649379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d0dc-7b43-4a77-b1f8-d4a7550e095a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.699950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.700978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.701453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.702605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.703847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:44.704396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:44.707703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:44.726982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 365/758] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:44.727925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:44.742558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 394/759] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:44.743838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8e73-025b-4d81-b13d-1ce9331c43b0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:44.759623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:44.816023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:44.861995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8e73-025b-4d81-b13d-1ce9331c43b0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.901334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.901920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.902222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.902463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220777f8-4364-48b8-90ed-6c3a5500b371 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:44.902664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:44.920483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:44.922035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:44.946727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:44.948913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:44.951219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 395/760] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:44.959682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:44.970167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:44.970818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:44.971050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:44.971324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.119679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.123913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.146151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8765ae6-7173-4184-85d8-627fa281cfd9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:45.169057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:45.171162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:45.185588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:45.186292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.186643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.186988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.187784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:45.188158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.189655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.207518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 396/761] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:45.207518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:45.275248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 366/762] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:13:45.276520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:45.330008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c833ed-051e-4c54-a94c-c70f680fb1ed None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:45.371035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:45.372180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.372913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.373382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.374155 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.375740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:45.385219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:45.387065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:45.388289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:45.391477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 397/763] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Sep 26 12:13:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:45.392602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:45.414964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac87b9e-1d4a-402d-8658-b36510875c7c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:45.447722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:45.448632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:45.456232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699759b-9a17-4c8e-ae46-be4fee49e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:45.457131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699759b-9a17-4c8e-ae46-be4fee49e276 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.457404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699759b-9a17-4c8e-ae46-be4fee49e276 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.457673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699759b-9a17-4c8e-ae46-be4fee49e276 None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/952c5c9a37a54497aab20652d0282690/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.459575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699759b-9a17-4c8e-ae46-be4fee49e276 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=952c5c9a37a54497aab20652d0282690, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.461007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699759b-9a17-4c8e-ae46-be4fee49e276 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.502119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a383ab-947e-418b-9a14-199edc5c6899 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:45.543116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28701f-9297-4f69-b021-c9f750f0d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:45.543768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28701f-9297-4f69-b021-c9f750f0d49b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.544051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28701f-9297-4f69-b021-c9f750f0d49b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.544324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28701f-9297-4f69-b021-c9f750f0d49b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.555628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 367/764] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:45 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/952c5c9a37a54497aab20652d0282690/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:13:45.555628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7708af-5d33-4de6-a625-477ab7ca692a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.555628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7708af-5d33-4de6-a625-477ab7ca692a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.555628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7708af-5d33-4de6-a625-477ab7ca692a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.555628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 368/765] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:45.555628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7708af-5d33-4de6-a625-477ab7ca692a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:45.566504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28701f-9297-4f69-b021-c9f750f0d49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.568189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28701f-9297-4f69-b021-c9f750f0d49b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5e28701f-9297-4f69-b021-c9f750f0d49b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:45.587108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:45.588228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:45.589111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:45.589111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:45.589111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:45.589111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 398/766] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:45.590424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e220-88ea-426a-9118-9a88deea5688 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.590584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e220-88ea-426a-9118-9a88deea5688 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.590837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29e220-88ea-426a-9118-9a88deea5688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.616897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-be29e220-88ea-426a-9118-9a88deea5688 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:45.618195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-be29e220-88ea-426a-9118-9a88deea5688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:45.690870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7708af-5d33-4de6-a625-477ab7ca692a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:45.715646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 399/767] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:45.716606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29e220-88ea-426a-9118-9a88deea5688 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:45.763758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:45.764899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.764899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.764899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.765555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:45.765853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.767232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.777522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 369/768] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Sep 26 12:13:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:45.779003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:45.784475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:45.862261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:45.889700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29e220-88ea-426a-9118-9a88deea5688 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:45.932520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:45.934290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.934783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.935260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.936380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:45.937284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.939322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.946614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e078-a625-48ea-9b40-7a72854ae56f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:45.957519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 400/769] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:45.964868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:45.988588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:45.989112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:45.989341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:45.989607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:45.990245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:45.990547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:45.992003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:45.998755 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 370/770] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Sep 26 12:13:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:46.004548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.096019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff083e-754e-4305-98bd-d20c1532a6bb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.098065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:46.125787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1f00-46c4-4af7-8caf-adf4c7b5c053 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.141106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.141749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.142070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.142288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.143571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:46.150590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:46.152126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:46.164304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e3cb7-41b9-43b0-afda-7729e6c36c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.164920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3cb7-41b9-43b0-afda-7729e6c36c0b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.165194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3cb7-41b9-43b0-afda-7729e6c36c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.165464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e3cb7-41b9-43b0-afda-7729e6c36c0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.166162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3cb7-41b9-43b0-afda-7729e6c36c0b None admin] RBAC: Adding query filter params (interface=public, service_id=9dcb4b513e8b424da569f97f455c0e84, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:46.166438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:46.167245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:46.168844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:46.169266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3cb7-41b9-43b0-afda-7729e6c36c0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:46.169337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 401/771] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:46.169404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.173240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e3cb7-41b9-43b0-afda-7729e6c36c0b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:46.181611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 371/772] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/endpoints?service_id=9dcb4b513e8b424da569f97f455c0e84&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:46.182702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a342f90-60b9-4713-849d-9008b4f54c42 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.182985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a342f90-60b9-4713-849d-9008b4f54c42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.183413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a342f90-60b9-4713-849d-9008b4f54c42 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.187428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 372/773] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:46.187428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a342f90-60b9-4713-849d-9008b4f54c42 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.302349 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9bfb-e72a-48b8-9d9b-2dcb5ad88bde None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.309297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a342f90-60b9-4713-849d-9008b4f54c42 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.345302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.345942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.346222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.346494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] PATH_INFO: `/v3/services/network` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.347086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:46.348676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:46.351218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f97f1-f80a-4ba6-8012-aee951e29e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.351855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f97f1-f80a-4ba6-8012-aee951e29e81 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.352133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f97f1-f80a-4ba6-8012-aee951e29e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.352408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f97f1-f80a-4ba6-8012-aee951e29e81 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.353090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f97f1-f80a-4ba6-8012-aee951e29e81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:46.353390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f97f1-f80a-4ba6-8012-aee951e29e81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:46.354798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f97f1-f80a-4ba6-8012-aee951e29e81 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:46.359766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:46.360734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:46.361595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:46.363962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 402/774] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:46.364777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.371823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 373/775] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:46.373502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef4b7-079a-41cb-9b07-facf06fa5790 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.373960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef4b7-079a-41cb-9b07-facf06fa5790 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.374396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef4b7-079a-41cb-9b07-facf06fa5790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.382703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:46.394361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fb9ef4b7-079a-41cb-9b07-facf06fa5790 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:46.395085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb9ef4b7-079a-41cb-9b07-facf06fa5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:46.445414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:46.493815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 374/776] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:46.495067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ef4b7-079a-41cb-9b07-facf06fa5790 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.526204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99f2ac-04dc-4201-a777-7b53a33d6208 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.580889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.582406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.583092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.583698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.584592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:46.587264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:46.603821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 403/777] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:46.605714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.670631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ef4b7-079a-41cb-9b07-facf06fa5790 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.739480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246909d9-29df-4742-962c-309ef2279509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.740115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246909d9-29df-4742-962c-309ef2279509 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.740603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246909d9-29df-4742-962c-309ef2279509 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.741019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246909d9-29df-4742-962c-309ef2279509 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.741686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246909d9-29df-4742-962c-309ef2279509 None admin] RBAC: Adding query filter params (name=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:46.741994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246909d9-29df-4742-962c-309ef2279509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:46.743762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246909d9-29df-4742-962c-309ef2279509 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:46.750343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 375/778] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:46.757015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246909d9-29df-4742-962c-309ef2279509 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.792010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:46.814518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:46.825149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08d10-43ad-4c33-8eb7-a04414ec1439 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.880455 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.881677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.882579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.883033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.883987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=eb9b8e4dd597472699dc3c724c4464a0) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:46.884473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:46.886701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:46.895308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 404/779] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/role_assignments?user.id=eb9b8e4dd597472699dc3c724c4464a0&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:46.896752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:46.902793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246909d9-29df-4742-962c-309ef2279509 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:46.994525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:46.996362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:46.996855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:46.997332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:46.998289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:46.998819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:47.001410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:47.014658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 376/780] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:47.023395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:47.137688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdcc33-f770-4963-ae08-6a3a1f60914e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:47.185933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:47.186603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:47.186849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:47.187117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:47.197697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:47.202756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2b68e-4f9a-4608-90ef-0c14a7cd92b1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:47.205354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:47.209448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:47.221286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:47.240674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 405/781] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:47.241518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:47.252653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:47.253273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:47.253549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:47.253821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:47.254523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] RBAC: Adding query filter params (interface=public, service_id=11314b2719254be790e4d60f3d491f0c, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:47.254827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:47.256213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:47.269341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 377/782] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:13:47 2022] GET /identity/v3/endpoints?service_id=11314b2719254be790e4d60f3d491f0c&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:47.275259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:47.344342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3533-215d-47d9-adf0-0d15304f5932 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:47.380836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:47.381742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:47.382024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:47.382293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:47.382965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:47.383263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:47.384692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:47.394866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 406/783] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:47.400345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:47.463809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:47.513392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ef54-f1f3-4332-9538-4fe94f3eeaca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:47.553973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc539c2-031f-4b9c-bf75-c8a534a8f404 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:47.595176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:47.595853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:47.596137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:47.599417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:47.621647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:47.623116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:47.627705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:47.628382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:47.628662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:47.630193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:47.630888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:47.632279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:47.646115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:47.647098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:47.648003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:47.648003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:47.648003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:47.650103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 407/784] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:47.655476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 378/785] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:13:47 2022] GET /identity/v3/services => generated 772 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:47.657624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:47.779615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb2f91-031b-4fd4-83a0-54e98fdb13c4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:47.795417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:47.820407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:47.821440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:47.821940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:47.822412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:47.823518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:47.824828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:47.826616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:47.841959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 408/786] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:47.848237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:47.879251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:47.961450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f6e6-d6f5-45aa-ba0f-f4b0b445cf73 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:48.001439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa042afe-fcca-4886-8d1e-8cbaaa3a4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:48.002188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa042afe-fcca-4886-8d1e-8cbaaa3a4190 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:48.002350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa042afe-fcca-4886-8d1e-8cbaaa3a4190 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:48.002676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa042afe-fcca-4886-8d1e-8cbaaa3a4190 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:48.010777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa042afe-fcca-4886-8d1e-8cbaaa3a4190 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:48.013081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa042afe-fcca-4886-8d1e-8cbaaa3a4190 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fa042afe-fcca-4886-8d1e-8cbaaa3a4190 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:48.027330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:48.028346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:48.029287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 379/787] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:48.036290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:48.291204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4588e9d-2c50-43a9-8eac-f88db7c95b3b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:48.326769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:48.327395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:48.327675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:48.327940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:48.328671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:48.328969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:48.330373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:48.345983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05100a8-1dc1-4f04-a42d-a12201ed8897 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:48.346306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05100a8-1dc1-4f04-a42d-a12201ed8897 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:48.346530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05100a8-1dc1-4f04-a42d-a12201ed8897 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:48.348791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 409/788] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Sep 26 12:13:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:48.354467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:48.354792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 380/789] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:48.363281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de63c-2687-499e-8c71-d2ded1178ed5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:48.363640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de63c-2687-499e-8c71-d2ded1178ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:48.363868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17de63c-2687-499e-8c71-d2ded1178ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:48.388977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:48.410076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b17de63c-2687-499e-8c71-d2ded1178ed5 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:48.414181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b17de63c-2687-499e-8c71-d2ded1178ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:48.491819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b542e-81a5-4667-b8d0-095a4f2d7928 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:48.566734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:48.567406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:48.568063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:48.568357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:48.584151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:48.585673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:48.591594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 381/790] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:48.611896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:48.612893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:48.614398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:48.614398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:48.614398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:48.614398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 410/791] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:48.618894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17de63c-2687-499e-8c71-d2ded1178ed5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:48.643838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:48.758034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17de63c-2687-499e-8c71-d2ded1178ed5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:48.802574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:48.803520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:48.803870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:48.804151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:48.804813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:48.805118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:48.806527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:48.820675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 382/792] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:48.829560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:48.956595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:48.974812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a3120-c0a1-4d2e-8ab6-b5bc53f9326a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:49.014853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:49.015680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.015963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.016250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.028147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:49.030018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:49.049472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:49.051736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:49.053975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:49.054983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:49.055522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 411/793] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:49.059288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:49.167021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f196d6-22a3-4d94-af3c-0b789b09c4fe None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:49.206786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:49.207542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.207827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.208100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.208791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:49.209092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:49.210622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:49.225156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 412/794] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:49.232381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:49.236818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:49.280423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:49.360134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d1820-8bcb-4acb-b2e6-437a599c2bc8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:49.385386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df6bfc-b598-40e4-8179-214dcac26327 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:49.400906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320bca5-5d12-4a1b-83f0-95832642ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:49.402412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320bca5-5d12-4a1b-83f0-95832642ed12 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.402843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320bca5-5d12-4a1b-83f0-95832642ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.403257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320bca5-5d12-4a1b-83f0-95832642ed12 None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/b99893144ac74cc9aec6d197c3dc1bc9/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.405948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320bca5-5d12-4a1b-83f0-95832642ed12 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=b99893144ac74cc9aec6d197c3dc1bc9, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:49.407607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320bca5-5d12-4a1b-83f0-95832642ed12 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:49.442471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdf3f0-452a-41ac-a038-4e4b31c35406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:49.443448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf3f0-452a-41ac-a038-4e4b31c35406 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.443875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf3f0-452a-41ac-a038-4e4b31c35406 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.444293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdf3f0-452a-41ac-a038-4e4b31c35406 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.455850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdf3f0-452a-41ac-a038-4e4b31c35406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-25bdf3f0-452a-41ac-a038-4e4b31c35406 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:49.462198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:49.463214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:49.464213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:49.467035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 383/795] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:49.468404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dff8e-ac13-4303-8c58-bb417710218c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.468691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dff8e-ac13-4303-8c58-bb417710218c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.468967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6dff8e-ac13-4303-8c58-bb417710218c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.471380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 384/796] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:49.471674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac299f-6fdc-4158-b467-b51da2e064bc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.472015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac299f-6fdc-4158-b467-b51da2e064bc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.472293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac299f-6fdc-4158-b467-b51da2e064bc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.473586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 385/797] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:49.478008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac299f-6fdc-4158-b467-b51da2e064bc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:49.482350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 413/798] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:49 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/b99893144ac74cc9aec6d197c3dc1bc9/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:13:49.483538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788421-e394-4eb0-a717-c222f7b7caba None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.483809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788421-e394-4eb0-a717-c222f7b7caba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.491085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788421-e394-4eb0-a717-c222f7b7caba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.504390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d8788421-e394-4eb0-a717-c222f7b7caba None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:49.505847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d8788421-e394-4eb0-a717-c222f7b7caba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:49.604519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 414/799] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:49.607813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcbca3-9501-40f0-87e6-3402814ef8e3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.608326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcbca3-9501-40f0-87e6-3402814ef8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.608775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcbca3-9501-40f0-87e6-3402814ef8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.620873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac299f-6fdc-4158-b467-b51da2e064bc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:49.632392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-76bcbca3-9501-40f0-87e6-3402814ef8e3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:49.634499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-76bcbca3-9501-40f0-87e6-3402814ef8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:49.637787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:49.676860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:49.677784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.678216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.678595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.679430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:49.680044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:49.681805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:49.699751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:49.703769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 386/800] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:49.710164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:49.751081 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 415/801] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:49.839359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8eebb-c7a2-4732-8a1e-7e2b00cab5f2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:49.898087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:49.899064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:49.899677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:49.900184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:49.917812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:49.919673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:49.929738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcbca3-9501-40f0-87e6-3402814ef8e3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:49.945047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:49.946149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:49.947042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:49.947042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:49.947042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:49.947654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 387/802] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:49.952711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.047788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:50.125530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3272b-b39f-4b95-aa8d-0eded01ef5de None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.134946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcbca3-9501-40f0-87e6-3402814ef8e3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.161563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:50.174365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.175003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.176970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.176970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.176970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.177614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:50.187830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:50.188878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:50.190538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 416/803] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Sep 26 12:13:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:50.191324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.200313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.201317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.201803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.202279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.203132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:50.203681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.205371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.219766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 388/804] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:50.221003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.301170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c489a-caa7-4d88-ad62-a2093a515e41 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.334728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970db0c7-ae9f-45f8-a308-e31dbc0a777e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.338942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.340897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.340897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.341261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.350130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:50.353428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:50.358991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:50.361010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 417/805] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:50.362165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.384355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.385357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.385862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.386567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.387765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:50.388311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.389922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.395751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 389/806] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Sep 26 12:13:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:50.396935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.416634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:50.473598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e300ee-5322-44f8-a4ff-b6739047248b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.513229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ec13a-cac6-4845-a7c0-c6b65bc62478 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.515969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.516690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.516970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.517245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.526747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.529352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:50.542264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:50.543326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:13:50.544490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:50.548551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 418/807] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:13:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:50.549432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.564106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.564818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.565151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.565494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.566137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:50.566445 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.567878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.581939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 390/808] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:50.582660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.630347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:50.691152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a13b-03aa-455d-b5b0-2b5b9d45cff2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.700078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:50.721403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd00eb4-64e6-493f-9dfe-bcc215c53575 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.732033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.732654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.732934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.733212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.733927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:50.734679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.736684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.748611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 419/809] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Sep 26 12:13:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:50.748611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.762862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfabac4-5c94-4400-8429-28b4467eb350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.763603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfabac4-5c94-4400-8429-28b4467eb350 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.763878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfabac4-5c94-4400-8429-28b4467eb350 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.764148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfabac4-5c94-4400-8429-28b4467eb350 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.764872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfabac4-5c94-4400-8429-28b4467eb350 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:50.765170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfabac4-5c94-4400-8429-28b4467eb350 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.766606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfabac4-5c94-4400-8429-28b4467eb350 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.787141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 391/810] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:13:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:50.788192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7e2a-f386-433d-bdf9-b0b5c37993d2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.788481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7e2a-f386-433d-bdf9-b0b5c37993d2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.788745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf7e2a-f386-433d-bdf9-b0b5c37993d2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.790146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 392/811] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:50.794905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf7e2a-f386-433d-bdf9-b0b5c37993d2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:50.889368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1887a2-951f-4633-b47a-ec1a27d9f5e9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.922280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:50.928630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf1406-e59c-4ffd-becd-e8b1fdb5ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.929484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1406-e59c-4ffd-becd-e8b1fdb5ac68 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.929597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1406-e59c-4ffd-becd-e8b1fdb5ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.929795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf1406-e59c-4ffd-becd-e8b1fdb5ac68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.936361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf7e2a-f386-433d-bdf9-b0b5c37993d2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:50.941546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf1406-e59c-4ffd-becd-e8b1fdb5ac68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.942917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf1406-e59c-4ffd-becd-e8b1fdb5ac68 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-27cf1406-e59c-4ffd-becd-e8b1fdb5ac68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:50.959556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:50.961445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:50.964079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:50.964079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:50.964079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:50.964079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 420/812] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:50.964079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447fdab-45e4-4c07-b0e9-affd63ee1fb6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.964079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447fdab-45e4-4c07-b0e9-affd63ee1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.964079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447fdab-45e4-4c07-b0e9-affd63ee1fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.984615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e447fdab-45e4-4c07-b0e9-affd63ee1fb6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:50.985794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e447fdab-45e4-4c07-b0e9-affd63ee1fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:50.989727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:50.990359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:50.990631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:50.990896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:50.991596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:50.992963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:51.005960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:51.060551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 421/813] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:51.061761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447fdab-45e4-4c07-b0e9-affd63ee1fb6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:51.097816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 393/814] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:13:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:51.097816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:51.231733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447fdab-45e4-4c07-b0e9-affd63ee1fb6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:51.286937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:51.287618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:51.287955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:51.288236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:51.313470 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:51.368579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53076-c6a0-4ae8-a4b5-b7cac0171e4c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:51.379445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:51.381885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:51.430524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:51.431168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:51.431724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:51.432004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:51.432703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:51.433018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:51.434954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:51.449451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 394/815] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:51.451181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:51.473637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:51.527129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 422/816] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:13:51.528159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:51.605983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:51.608128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7450b3b-4d65-477c-91f8-a723f3cbd8b3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:51.668086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:51.668871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:51.669146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:51.669414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] PATH_INFO: `/v3/services/network` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:51.670005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:51.672270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:51.674773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df564b-bd07-4a7f-94e8-4cfb5de5c4a5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:51.688749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:51.689795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:51.690629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 395/817] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:51.691434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:51.721692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:51.722736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:51.723234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:51.723688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:51.734014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:51.736276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:51.751855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:51.753641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:13:51.755475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:51.757709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 423/818] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:51.759280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:51.800733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:51.829768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc55409-aaeb-4b82-82ca-ee2c82e75979 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:51.869755 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:51.870907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:51.871700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:51.872211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:51.884432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:51.886358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:51.899493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afaf3b5-b481-4f93-ba7c-14bc72556ece None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:51.904883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:51.905939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:51.906892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:51.906892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:51.906892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:51.909078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 396/819] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:51.910033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:51.910410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:51.944758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:51.945375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:51.945656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:51.945928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:51.947093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] RBAC: Adding query filter params (name=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:51.947422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:51.949175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:51.955879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 424/820] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:51.957796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.052090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2b6ac-31e1-4c1a-a7c9-aed34d7783ff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.092552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:52.103220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.104001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.104299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.104612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.105468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:52.105821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.107148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b31ff0-9d45-484d-b6de-966ecbb3ccfd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.107333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.134226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 397/821] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:52.135674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.148930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.149938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.150428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.150926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.151985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:52.152861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.154643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.169631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 425/822] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:52.170812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.219713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:52.270069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ecc41-1575-4a0b-87bc-1cc8b6c1cfd7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.317504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd55008-5d56-4d13-9a34-b1780930383f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.318083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fbae1-c7fd-4775-b9bb-bf78ae72b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.318552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fbae1-c7fd-4775-b9bb-bf78ae72b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.319189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fbae1-c7fd-4775-b9bb-bf78ae72b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.320570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fbae1-c7fd-4775-b9bb-bf78ae72b6a7 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.321312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fbae1-c7fd-4775-b9bb-bf78ae72b6a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:52.322398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fbae1-c7fd-4775-b9bb-bf78ae72b6a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.323635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fbae1-c7fd-4775-b9bb-bf78ae72b6a7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.342845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 398/823] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:13:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:52.342845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43755ff2-5ed6-4c0c-acdd-9b9e7da0b5ba None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.342845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43755ff2-5ed6-4c0c-acdd-9b9e7da0b5ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.342845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43755ff2-5ed6-4c0c-acdd-9b9e7da0b5ba None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.342845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 399/824] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:52.342845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43755ff2-5ed6-4c0c-acdd-9b9e7da0b5ba None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.358733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.359398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.359713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.359941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.373827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.375212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:52.394993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:52.396662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:52.397606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:52.397606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:52.397606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:52.398434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 426/825] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:52.399617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.412465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:52.477976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43755ff2-5ed6-4c0c-acdd-9b9e7da0b5ba None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.504748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:52.518628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b734efb-1254-4333-94fe-64a67c6f9ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.519279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734efb-1254-4333-94fe-64a67c6f9ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.519588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734efb-1254-4333-94fe-64a67c6f9ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.519863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734efb-1254-4333-94fe-64a67c6f9ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.524383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1026e-0561-4d7f-918a-07fd560386ce None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.527806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b734efb-1254-4333-94fe-64a67c6f9ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.529296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b734efb-1254-4333-94fe-64a67c6f9ca0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4b734efb-1254-4333-94fe-64a67c6f9ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:52.542594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:52.543858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 400/826] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0b464-87da-441e-8deb-e15942cd9e3f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.544994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0b464-87da-441e-8deb-e15942cd9e3f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.545691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0b464-87da-441e-8deb-e15942cd9e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.567262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-44c0b464-87da-441e-8deb-e15942cd9e3f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:52.568626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-44c0b464-87da-441e-8deb-e15942cd9e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:52.571937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.572634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.573008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.573353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.574883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.576551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.652929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 401/827] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:52.653851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0b464-87da-441e-8deb-e15942cd9e3f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.668048 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 427/828] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:13:52 2022] POST /identity/v3/endpoints => generated 337 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:52.669039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.767727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:52.852764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc24ae-3b34-4161-b862-a9db3ad83c7d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.902145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0b464-87da-441e-8deb-e15942cd9e3f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:52.902448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.904858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.904858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.904858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.904858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:52.904858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.906292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.911395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:52.924365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 428/829] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:52.931999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:52.957393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:52.958094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:52.958375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:52.958644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:52.959298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:52.960418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:52.961310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:52.982291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 402/830] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:52.983663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:53.068561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d47db-d754-4f93-807b-c011b5d9f70e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:53.118185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:53.122676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:53.123287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.123591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.123693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5679e6-22be-4ae9-b5a3-c8a156bbba4d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:53.123863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.124598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=952c5c9a37a54497aab20652d0282690) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:53.124897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:53.126433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:53.132730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 429/831] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:52 2022] GET /identity/v3/role_assignments?user.id=952c5c9a37a54497aab20652d0282690&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:53.133553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:53.187530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:53.188518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.188981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.189765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.212735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:53.215284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:53.226814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:53.234997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:53.248026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:53.249259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 403/832] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:53.250074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:53.283427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33905f0f-aa28-4c77-890b-f6bba49b2dd9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:53.325423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:53.326415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.326757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.327035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.340270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:53.346206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:53.347227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:53.348307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 430/833] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:53.356799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:53.398211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076df726-e0a8-424a-99db-b6b0966627fc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:53.448517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:53.449463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.449895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.450321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.451480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:53.451965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:53.454374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:53.474945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 404/834] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:53.480775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:53.507138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:53.532703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bff178-8f45-4129-995a-58b5041d963f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:53.556070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:53.571832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:53.572555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.572837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.573106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.574336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:53.574636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:53.576103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:53.586181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 431/835] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:53.594239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:53.621207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e0ca-306e-436a-99d7-2b733530faf7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:53.660605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c188fd-18c8-4b9e-aa04-40e512126907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:53.661199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c188fd-18c8-4b9e-aa04-40e512126907 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.661526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c188fd-18c8-4b9e-aa04-40e512126907 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.661808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c188fd-18c8-4b9e-aa04-40e512126907 None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/eb9b8e4dd597472699dc3c724c4464a0/roles/e5d4d76180364a138e4c8c41652caa4d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.678053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c188fd-18c8-4b9e-aa04-40e512126907 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=eb9b8e4dd597472699dc3c724c4464a0, role_id=e5d4d76180364a138e4c8c41652caa4d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:53.679550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c188fd-18c8-4b9e-aa04-40e512126907 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:53.716115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883eac1-130d-4e80-9f8f-3103d25c09a9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:53.762603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:53.763145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 405/836] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:13:53 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/eb9b8e4dd597472699dc3c724c4464a0/roles/e5d4d76180364a138e4c8c41652caa4d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:13:53.763742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.764238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.764727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.765324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5927-4b2f-4c78-bdd9-7d038c42e50f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.765764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5927-4b2f-4c78-bdd9-7d038c42e50f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.766029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5927-4b2f-4c78-bdd9-7d038c42e50f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.767770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 406/837] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:53.775971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58abe-af78-4e61-be81-8ca1fb15c1ba None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:53.776312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58abe-af78-4e61-be81-8ca1fb15c1ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:53.776495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58abe-af78-4e61-be81-8ca1fb15c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:53.796286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:53.799017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:53.826793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f4e58abe-af78-4e61-be81-8ca1fb15c1ba None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:53.828210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:53.835760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:53.837382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:53.837382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:53.837382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:53.837382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 432/838] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:53.838987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f4e58abe-af78-4e61-be81-8ca1fb15c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:53.842699 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:53.893047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:53.959698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:53.971825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 407/839] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:53.983275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5fc91-2df8-4a91-801f-227ede876db3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:54.022998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:54.023647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:54.023927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:54.024209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:54.024902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:54.025205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:54.027145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:54.041055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 433/840] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:54.050890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e58abe-af78-4e61-be81-8ca1fb15c1ba None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:54.177472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e58abe-af78-4e61-be81-8ca1fb15c1ba None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:54.218753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:54.219675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:54.220197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:54.220622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:54.229293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:54.231578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:54.245385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:54.246788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 12:13:54.248070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:54.250321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 408/841] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:13:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:54.256271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:54.319575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:54.405850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:54.435762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:54.453269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41ac3f-956f-49b7-a628-a0f77d37ac10 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:54.455784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f7da0-54ac-4797-91f1-6bbd27d88844 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:54.509341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:54.510531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:54.510983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:54.511717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:54.513303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:54.513769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:54.515514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:54.519959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:54.520943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:54.521511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:54.522065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:54.523230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:54.526176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:54.543782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 434/842] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Sep 26 12:13:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:54.546649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:54.547870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:13:54.548889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:54.549873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:54.551825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 409/843] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:13:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:54.557315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:54.672108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5520ba-ff13-484f-806b-8bea22fb3594 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:54.702690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:54.713148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9c5e6-527a-4121-80ea-0c26823c50c9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:54.716575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:54.717311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:54.718405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:54.718405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:54.718750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:54.719170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:54.721019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:54.731739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 410/844] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:13:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:54.732841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:54.765424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:54.766699 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:54.767173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:54.767741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:54.802338 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:54.857780 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:54.859569 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:54.876645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4918e-e364-469e-b8f6-2e50e8ae3200 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:54.928415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:54.930850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:54.931912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:54.932380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:54.934885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:54.935388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:54.937117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:54.943770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 411/845] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:13:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:55.005365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 435/846] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 12:13:55.014743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:55.115064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:55.200025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf576a6-d321-4db0-9e83-af4b4e3b635c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:55.243998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:55.245045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:55.245610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:55.246096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:55.258612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:55.260505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:55.283290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:55.285241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:55.287084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:55.287084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:55.287084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:55.290889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 412/847] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:55.302327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:55.400898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:55.469642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75174a-0d6f-4e48-b9e9-c4dd9391bce8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:55.511055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff4b8-d21a-487a-ac13-40bd86568315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:55.512350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff4b8-d21a-487a-ac13-40bd86568315 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:55.512804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff4b8-d21a-487a-ac13-40bd86568315 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:55.513235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff4b8-d21a-487a-ac13-40bd86568315 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:55.514072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff4b8-d21a-487a-ac13-40bd86568315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:55.514569 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff4b8-d21a-487a-ac13-40bd86568315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:55.516544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff4b8-d21a-487a-ac13-40bd86568315 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:55.532365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 436/848] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:55.540531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:55.694093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910464-d325-4a9b-8de4-4c9301c1f314 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:55.697054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:55.741892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:55.742954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:55.743522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:55.743998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:55.752608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:55.754502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:55.768929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:55.769895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:55.770770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:55.773365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 413/849] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:55.780020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:55.780584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4ce9-7434-45b6-957e-a5a885a01347 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:55.781096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4ce9-7434-45b6-957e-a5a885a01347 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:55.781575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4ce9-7434-45b6-957e-a5a885a01347 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:55.786084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 437/850] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:55.794639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d34b20-4930-4ba5-8356-e39cd457f5bd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:55.795299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d34b20-4930-4ba5-8356-e39cd457f5bd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:55.796212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d34b20-4930-4ba5-8356-e39cd457f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:55.834159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-72d34b20-4930-4ba5-8356-e39cd457f5bd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:55.836691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-72d34b20-4930-4ba5-8356-e39cd457f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:55.913203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735023-4587-45c2-a7fa-023bf95f2600 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:55.943438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 438/851] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:55.962904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ba673-0bb8-4972-b7a4-6067789b3f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:55.964018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba673-0bb8-4972-b7a4-6067789b3f48 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:55.964556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba673-0bb8-4972-b7a4-6067789b3f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:55.965327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba673-0bb8-4972-b7a4-6067789b3f48 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:55.966317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba673-0bb8-4972-b7a4-6067789b3f48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:55.966897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba673-0bb8-4972-b7a4-6067789b3f48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:55.969634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba673-0bb8-4972-b7a4-6067789b3f48 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:55.993544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 414/852] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:56.000613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d34b20-4930-4ba5-8356-e39cd457f5bd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:56.049822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:56.105172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9101d14-3c51-4439-9a89-5758ab1f616a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.105807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9101d14-3c51-4439-9a89-5758ab1f616a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.106316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9101d14-3c51-4439-9a89-5758ab1f616a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.108321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 415/853] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:13:56.114707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7ca8-c647-4902-a4fc-c2ab3e23be45 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.114996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7ca8-c647-4902-a4fc-c2ab3e23be45 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.115255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7ca8-c647-4902-a4fc-c2ab3e23be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.129445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d34b20-4930-4ba5-8356-e39cd457f5bd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:56.144593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4f1c7ca8-c647-4902-a4fc-c2ab3e23be45 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:56.146455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4f1c7ca8-c647-4902-a4fc-c2ab3e23be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:56.172734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:56.180260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:56.180970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.181322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.184416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.184416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=b99893144ac74cc9aec6d197c3dc1bc9) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:56.184416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:56.185657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:56.194380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 439/854] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:55 2022] GET /identity/v3/role_assignments?user.id=b99893144ac74cc9aec6d197c3dc1bc9&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:56.247130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 416/855] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:13:56.263968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:56.386644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30499ee9-909d-49a4-8664-5004bcf567e7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:56.395702 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:56.436404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:56.437261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.437718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.437990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.438585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:56.440066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:56.450074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:56.452018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:56.453826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 440/856] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Sep 26 12:13:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:56.457256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7ca8-c647-4902-a4fc-c2ab3e23be45 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:56.533296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:56.632663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7ca8-c647-4902-a4fc-c2ab3e23be45 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:56.659209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a7b9d-aee0-44cd-8717-6fd336ca82c6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:56.683500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:56.684615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.685118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.685649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.686739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:56.687279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:56.688957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:56.694667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 417/857] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:13:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:56.702485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:56.709133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:56.709785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.710065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.710340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.722841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:13:56.725713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:13:56.728500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:56.729459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:13:56.730895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:56.735619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 441/858] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:56.737208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:56.789304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:56.865430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdeb2-2032-4c71-b4e3-9afe7a37a797 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:56.898859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693642b8-6005-4f05-91f5-59304ab364fb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:56.915601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:56.916757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.917492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.918104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.919137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:56.919746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:56.921567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:56.935800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 418/859] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:13:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:56.953937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:56.954766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:56.955049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:56.955326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:56.956175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:56.956482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:56.958007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:56.971330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 442/860] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:13:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:56.977878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:57.111259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:57.139972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157c90-07e8-448b-b78e-dca507e6655f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:57.197580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:57.198232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:57.198588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:57.198858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:57.215498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:57.216494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:57.234262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:57.235536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:57.237297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:57.237297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:57.237297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:57.237297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 419/861] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:57.244795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:57.404878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:57.414944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f270b84-91c2-4a84-9fde-df55f9f41e61 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:57.454636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c16e2-b791-4bdc-8007-47d88b86bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:57.455284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c16e2-b791-4bdc-8007-47d88b86bf58 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:57.455604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c16e2-b791-4bdc-8007-47d88b86bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:57.456277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c16e2-b791-4bdc-8007-47d88b86bf58 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:57.457068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c16e2-b791-4bdc-8007-47d88b86bf58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:57.457480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c16e2-b791-4bdc-8007-47d88b86bf58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:57.458979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c16e2-b791-4bdc-8007-47d88b86bf58 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:57.475897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 443/862] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:57.482390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:57.660523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe3d1-26f5-431b-a080-6b40ae11c47f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:57.716892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:57.724151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:57.725213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:57.725697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:57.726172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:57.740532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:57.742341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:57.752967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38689a-c2ff-42c0-b913-86d5c26fb417 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:57.753389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38689a-c2ff-42c0-b913-86d5c26fb417 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:57.753730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38689a-c2ff-42c0-b913-86d5c26fb417 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:57.755499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 444/863] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:13:57.758586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:57.759797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:13:57.760696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:57.764196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 420/864] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:13:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:57.767400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfcd79-c83c-4a22-ab12-28e2fa2909f1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:57.767400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfcd79-c83c-4a22-ab12-28e2fa2909f1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:57.767400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfcd79-c83c-4a22-ab12-28e2fa2909f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:57.770750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:57.795540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0bcfcd79-c83c-4a22-ab12-28e2fa2909f1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:57.796944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0bcfcd79-c83c-4a22-ab12-28e2fa2909f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:57.907872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d01f7-cf78-4cf7-8341-423e8aa4a6f7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:57.912667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 445/865] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:13:57.969405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:57.970598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:57.971088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:57.971602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:57.972948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:57.973476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:57.976241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:58.010078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 421/866] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Sep 26 12:13:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:58.020544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfcd79-c83c-4a22-ab12-28e2fa2909f1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:58.129165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:58.149564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfcd79-c83c-4a22-ab12-28e2fa2909f1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:58.188046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:58.188593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:58.188873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:58.189149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:58.231821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:58.288226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:58.289865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:58.300141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:58.362918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37be220-e1a0-4a8e-9292-79c6eea7c536 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:58.393880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:58.419391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 446/867] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:13:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:13:58.424354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:58.426053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f1fc3-b973-4da3-b4d3-4fc16b8aefd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:58.427775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fc3-b973-4da3-b4d3-4fc16b8aefd1 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:58.428255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fc3-b973-4da3-b4d3-4fc16b8aefd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:58.429492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f1fc3-b973-4da3-b4d3-4fc16b8aefd1 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:58.430182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f1fc3-b973-4da3-b4d3-4fc16b8aefd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:58.432522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f1fc3-b973-4da3-b4d3-4fc16b8aefd1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:58.513542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 422/868] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:13:58 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:13:58.638827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5482d-d985-464f-b912-78677600d030 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:58.664188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82414-7ebd-408a-a50a-17d0f7d1db54 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:58.664757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82414-7ebd-408a-a50a-17d0f7d1db54 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:58.664984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf82414-7ebd-408a-a50a-17d0f7d1db54 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:58.667861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 423/869] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:58.677047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a6e0-fdfe-4017-b991-7f316db09e01 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:58.677802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a6e0-fdfe-4017-b991-7f316db09e01 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:58.678393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a6e0-fdfe-4017-b991-7f316db09e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:58.692914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:58.693854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:58.694328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:58.694801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:58.702265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e380a6e0-fdfe-4017-b991-7f316db09e01 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:58.703983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e380a6e0-fdfe-4017-b991-7f316db09e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:58.713085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:58.716194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:13:58.743613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:58.745632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:13:58.747508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:13:58.747508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:13:58.747508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:58.747508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 447/870] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:58.750773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:58.797016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:58.822024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 424/871] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:58.889098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda0f93-6718-43de-8551-c4bb9e3d2dbe None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:58.937294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:58.938254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:58.938743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:58.939222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:58.939928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:58.940428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:58.943259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:58.960827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 448/872] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:58.967695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a6e0-fdfe-4017-b991-7f316db09e01 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:59.018498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:59.107671 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a6e0-fdfe-4017-b991-7f316db09e01 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:59.124893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:59.168003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:59.168647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.168916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.169292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.180313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:59.181820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:13:59.198042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:59.200233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:13:59.201625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 425/873] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:13:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:13:59.205661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:59.272867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:59.290023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b28787-dfe0-4418-8318-210961dc7638 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:59.351186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:59.351868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.352145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.352493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.353167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:59.354848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:13:59.366277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:13:59.368233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:13:59.371935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:13:59.375148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 449/874] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:13:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:13:59.376027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:59.386459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:59.394327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e799df3-479b-4b8e-b0cd-3724bf613f7a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:59.469983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:59.470940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.471429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.471878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.472885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:59.473371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:59.475173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:59.494520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 426/875] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:59.496567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:59.507220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61f4c-3a2d-4237-a19d-e16b4420d126 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:59.574714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ac562-976e-4ccc-8709-17eb68788e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:59.575776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac562-976e-4ccc-8709-17eb68788e99 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.576261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac562-976e-4ccc-8709-17eb68788e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.576735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ac562-976e-4ccc-8709-17eb68788e99 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.577891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac562-976e-4ccc-8709-17eb68788e99 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:59.578604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac562-976e-4ccc-8709-17eb68788e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:59.581479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ac562-976e-4ccc-8709-17eb68788e99 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:59.595376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 450/876] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:13:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:13:59.595376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01750-67ed-466e-9c62-48a4e22ba68b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.595376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01750-67ed-466e-9c62-48a4e22ba68b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.595376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01750-67ed-466e-9c62-48a4e22ba68b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.601331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 451/877] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:13:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:13:59.601331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01750-67ed-466e-9c62-48a4e22ba68b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:13:59.634653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:59.645288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe7413-79c1-4dd6-89c1-86616dbfe25a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:59.687427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72039a97-e154-4c1b-a6fd-cbcd40cf41aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:59.688442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039a97-e154-4c1b-a6fd-cbcd40cf41aa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.688442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039a97-e154-4c1b-a6fd-cbcd40cf41aa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.688735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72039a97-e154-4c1b-a6fd-cbcd40cf41aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.689347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72039a97-e154-4c1b-a6fd-cbcd40cf41aa None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=eb9b8e4dd597472699dc3c724c4464a0) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:59.689647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72039a97-e154-4c1b-a6fd-cbcd40cf41aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:59.691195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72039a97-e154-4c1b-a6fd-cbcd40cf41aa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:59.704608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 427/878] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:13:59 2022] GET /identity/v3/role_assignments?user.id=eb9b8e4dd597472699dc3c724c4464a0&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:13:59.705901 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51975c5-b650-463c-9866-2be1732110cd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.706168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51975c5-b650-463c-9866-2be1732110cd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.706444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51975c5-b650-463c-9866-2be1732110cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.726523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a51975c5-b650-463c-9866-2be1732110cd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:13:59.727846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a51975c5-b650-463c-9866-2be1732110cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:13:59.750017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:13:59.808652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01750-67ed-466e-9c62-48a4e22ba68b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:13:59.818022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 428/879] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:13:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:13:59.851085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef772ec8-ddce-4f19-b171-7b1fc2b37836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:13:59.851794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772ec8-ddce-4f19-b171-7b1fc2b37836 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:13:59.852013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772ec8-ddce-4f19-b171-7b1fc2b37836 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:13:59.852356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772ec8-ddce-4f19-b171-7b1fc2b37836 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:13:59.853016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772ec8-ddce-4f19-b171-7b1fc2b37836 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:13:59.853306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772ec8-ddce-4f19-b171-7b1fc2b37836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:13:59.854820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef772ec8-ddce-4f19-b171-7b1fc2b37836 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:13:59.860607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 452/880] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:13:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:00.103465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51975c5-b650-463c-9866-2be1732110cd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:00.230418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51975c5-b650-463c-9866-2be1732110cd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:00.276448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665cc88-426c-414d-bd00-20f5f13d15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:00.277807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665cc88-426c-414d-bd00-20f5f13d15f0 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:00.278084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665cc88-426c-414d-bd00-20f5f13d15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:00.278353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665cc88-426c-414d-bd00-20f5f13d15f0 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:00.279040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665cc88-426c-414d-bd00-20f5f13d15f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:00.280488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665cc88-426c-414d-bd00-20f5f13d15f0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:00.399653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 429/881] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:14:00 2022] POST /identity/v3/services => generated 269 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:01.065181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d779d-0d51-4bd9-9e52-d889101c7d9e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:01.066242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d779d-0d51-4bd9-9e52-d889101c7d9e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:01.066733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d779d-0d51-4bd9-9e52-d889101c7d9e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:01.069378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 453/882] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:01.076338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90489-b086-4134-9a1b-fad811899f46 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:01.077282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90489-b086-4134-9a1b-fad811899f46 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:01.077793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90489-b086-4134-9a1b-fad811899f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:01.103572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9bc90489-b086-4134-9a1b-fad811899f46 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:01.105542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9bc90489-b086-4134-9a1b-fad811899f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:01.117492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:01.194202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 430/883] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:01.476566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d779d-0d51-4bd9-9e52-d889101c7d9e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:01.574423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:01.597306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d779d-0d51-4bd9-9e52-d889101c7d9e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:01.652398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:01.653204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:01.653600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:01.654031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:01.655004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:01.656855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:01.671630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:01.672670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:01.673493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 454/884] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:14:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:01.679471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc90489-b086-4134-9a1b-fad811899f46 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:01.806217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc90489-b086-4134-9a1b-fad811899f46 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:01.849103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:01.850157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:01.850680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:01.851153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:01.852028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:01.852564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:01.854285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:01.861643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 431/885] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:14:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:01.869944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:01.988817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38d665-bfed-462b-9568-a2f25d48c253 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:02.029603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:02.030325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.030612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.030888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.031628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:02.031938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:02.033330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:02.039593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 455/886] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:14:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:02.046697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:02.062246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:02.184315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755fb0-09c7-41d2-819d-2230e495372e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:02.224029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8cbb4-4f5f-4328-a9b4-67ec9206070f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:02.224666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cbb4-4f5f-4328-a9b4-67ec9206070f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.224948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cbb4-4f5f-4328-a9b4-67ec9206070f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.225238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cbb4-4f5f-4328-a9b4-67ec9206070f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.225931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8cbb4-4f5f-4328-a9b4-67ec9206070f None admin] RBAC: Adding query filter params (interface=public, service_id=f5540fc780fc4b7494656137a1a95edb, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:02.226241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8cbb4-4f5f-4328-a9b4-67ec9206070f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:02.227684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8cbb4-4f5f-4328-a9b4-67ec9206070f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:02.234401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 432/887] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:14:02 2022] GET /identity/v3/endpoints?service_id=f5540fc780fc4b7494656137a1a95edb&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:02.240246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:02.257675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693fa1-d753-4458-a483-de5afd9068db None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.257987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693fa1-d753-4458-a483-de5afd9068db None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.258235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693fa1-d753-4458-a483-de5afd9068db None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.259823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 433/888] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:02.262196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:02.266719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11175-c547-4324-a9a1-c60b07f4846e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.267002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11175-c547-4324-a9a1-c60b07f4846e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.267273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11175-c547-4324-a9a1-c60b07f4846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.293769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-71f11175-c547-4324-a9a1-c60b07f4846e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:02.295015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-71f11175-c547-4324-a9a1-c60b07f4846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:02.380036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:02.395198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 434/889] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:02.396162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef7cf7-e3c9-4dca-a747-19e27ec0a309 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:02.438043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9d3d1-68a0-4aa4-a14b-746b06a76cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:02.438693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9d3d1-68a0-4aa4-a14b-746b06a76cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.438975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9d3d1-68a0-4aa4-a14b-746b06a76cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.439256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9d3d1-68a0-4aa4-a14b-746b06a76cb2 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.439930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9d3d1-68a0-4aa4-a14b-746b06a76cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:02.441392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9d3d1-68a0-4aa4-a14b-746b06a76cb2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:02.448747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 456/890] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:14:02 2022] GET /identity/v3/services => generated 1268 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:14:02.562037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1d2de-f556-49aa-b41a-5e1f3619feec None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.562414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1d2de-f556-49aa-b41a-5e1f3619feec None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.562581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1d2de-f556-49aa-b41a-5e1f3619feec None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.564598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 435/891] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:02.570674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17bd60-e386-4b8c-9dc6-4b0dc1ddee67 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.570981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17bd60-e386-4b8c-9dc6-4b0dc1ddee67 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.571241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17bd60-e386-4b8c-9dc6-4b0dc1ddee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.593085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ff17bd60-e386-4b8c-9dc6-4b0dc1ddee67 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:02.594343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ff17bd60-e386-4b8c-9dc6-4b0dc1ddee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:02.677188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 457/892] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:02.700189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1d2de-f556-49aa-b41a-5e1f3619feec None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:02.808560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5911b6-9962-4af4-a20a-6e83d7b25b46 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.808832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5911b6-9962-4af4-a20a-6e83d7b25b46 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.809181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5911b6-9962-4af4-a20a-6e83d7b25b46 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.810759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 458/893] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:02.816588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35830f75-83d2-4bcf-a700-8f4bb9750e6e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.816881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35830f75-83d2-4bcf-a700-8f4bb9750e6e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.817174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35830f75-83d2-4bcf-a700-8f4bb9750e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.833112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:02.837643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-35830f75-83d2-4bcf-a700-8f4bb9750e6e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:02.839119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-35830f75-83d2-4bcf-a700-8f4bb9750e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:02.873148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1d2de-f556-49aa-b41a-5e1f3619feec None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:02.936255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 459/894] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:02.940056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:02.940970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:02.941455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:02.941985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:02.955270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:02.960605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:02.961590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:02.962404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:02.964918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 436/895] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Sep 26 12:14:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:02.965799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35830f75-83d2-4bcf-a700-8f4bb9750e6e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:02.972079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.046250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:03.096277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35830f75-83d2-4bcf-a700-8f4bb9750e6e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.116636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ecc16-ae74-4cba-b3c2-6802444044a2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.139548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.140167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.140441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.140710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.141376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.142880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.146761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:03.165487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.166087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.184115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.184115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.184115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:03.184115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.184115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.184115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 437/896] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Sep 26 12:14:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:03.185057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.269041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 460/897] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:14:02 2022] POST /identity/v3/services => generated 241 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:03.269833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.318633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443061e7-47a5-4e07-9cfc-2d4b209fa7ff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.353906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:03.403431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.404111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.404408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.404665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.422781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.424857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.431294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1122b77-e7a4-416a-93e3-5e42147c53fb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:03.454433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:03.455828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:03.456720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:03.456720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:03.456720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:03.456720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 438/898] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:03.463165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.488691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.489915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.494660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.494660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.494660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.494660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:03.507324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:03.508394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:03.510076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 461/899] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:03.517023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.592146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:03.606424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7f65a-517d-4b16-a7b4-bb0a06d12a85 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.639183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4c2a3-28ab-4b6c-89c7-d034b493c683 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.645489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.646197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.646548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.646891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.647672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:03.648046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.649707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.666066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 439/900] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:03.672607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.683745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.684795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.685257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.685706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.686542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:03.687042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.688758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.694961 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 462/901] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:03.700663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.706719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:03.801764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1306df-1097-431d-9e3d-a201f59fb852 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.825774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8fa28-558a-4082-8cf2-129f6415124f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:03.844142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.844715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.844992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.845262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.855366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:03.858089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.860638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.869414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:03.871224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:03.872114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:03.872608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:03.873470 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:03.873978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:03.875710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:14:03.875847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:03.876729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:14:03.877728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:03.881821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 440/902] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:03.882844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:03.886514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 463/903] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:03.895445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:04.036541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:04.040586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f7a87-045a-4a7f-bddb-dd81622c2333 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:04.052776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc753f-bf95-4966-9754-951e7856ee0d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:04.097400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:04.097989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:04.098271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:04.098542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:04.099255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] RBAC: Adding query filter params (interface=public, service_id=d576bbe888334a3e85b8e6110f19b4ee, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:04.099662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:04.101030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:04.115523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 464/904] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/endpoints?service_id=d576bbe888334a3e85b8e6110f19b4ee&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:04.118772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:04.129217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:04.130790 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:04.131556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:04.132307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:04.133777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:04.134419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:04.138076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:04.164637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 441/905] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Sep 26 12:14:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:04.173546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:04.189650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:04.263112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c1bbe-486f-4fbf-b10a-d551a6d9c9e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:04.304501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:04.305200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:04.305543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:04.305887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:04.306567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:04.308083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:04.319434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 465/906] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:14:04 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:14:04.345998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab49442-6f94-4d77-a08d-9bf697f02ce6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:04.417860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d34670-19c8-469f-b593-d7aab1500bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:04.419426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34670-19c8-469f-b593-d7aab1500bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:04.420153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34670-19c8-469f-b593-d7aab1500bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:04.420868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34670-19c8-469f-b593-d7aab1500bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:04.451081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:04.560882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34670-19c8-469f-b593-d7aab1500bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:04.564200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34670-19c8-469f-b593-d7aab1500bf5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:04.706527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 442/907] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:04 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 12:14:04.716483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:04.806324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf7a6-84f8-4664-aee6-4d453dc3407a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:04.806685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf7a6-84f8-4664-aee6-4d453dc3407a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:04.807018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6acf7a6-84f8-4664-aee6-4d453dc3407a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:04.809663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 443/908] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:04.815359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545bd55-ded3-4d83-aa67-7a7fe5eb5074 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:04.815674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545bd55-ded3-4d83-aa67-7a7fe5eb5074 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:04.815912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545bd55-ded3-4d83-aa67-7a7fe5eb5074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:04.836576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8545bd55-ded3-4d83-aa67-7a7fe5eb5074 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:04.837851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8545bd55-ded3-4d83-aa67-7a7fe5eb5074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:04.838896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8f438-ed98-44cc-97dd-bfb25b4ade5d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:04.856322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:04.883169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:04.883837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:04.884114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:04.884384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:04.899976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:04.901600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:04.903675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:04.925319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:04.926545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:04.927904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:04.927904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:04.927904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:04.927904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 466/909] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:04.935988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:04.951446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 444/910] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:05.048160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b4c23-a3cc-4761-a78d-1ebedd305725 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:05.092312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:05.093167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.093645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.093974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.095084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:05.095489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:05.097193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:05.112211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 467/911] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:05.117584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545bd55-ded3-4d83-aa67-7a7fe5eb5074 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:05.231084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545bd55-ded3-4d83-aa67-7a7fe5eb5074 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:05.254011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:05.272188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:05.273228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.273657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.274088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.283069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:05.284859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:05.289034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:14:05.299070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:05.309127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 445/912] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:05.310202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:05.358736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:05.395487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc29a1a-4000-483f-9999-290d8d78c848 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:05.441698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84d3f6-5e54-4b28-b683-8d8bbaac923e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:05.456187 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:05.457343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.457779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.458488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.459727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:05.461531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:05.475171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:05.476482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 12:14:05.477503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:05.482748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 468/913] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:14:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:05.489669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:05.492266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:05.497191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.497191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.497191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.497191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:05.497191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:05.497191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:05.511615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 446/914] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:05.518168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:05.621883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:05.633346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecedd9-fe92-4df9-801d-647884aa5ab4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:05.655464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:05.664097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341aca8-4fd2-4161-b7c9-d94c7de21381 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:05.681007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:05.681986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.682271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.682622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.683284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:05.683619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:05.685297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:05.695514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 469/915] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:14:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:05.699616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:05.716760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:05.717364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.717662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.717964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.718948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] RBAC: Adding query filter params (role.id=d535a679597c4f65b406da0e467bae95, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=eb9b8e4dd597472699dc3c724c4464a0) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:05.719252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:05.721863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:05.735376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 447/916] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:05 2022] GET /identity/v3/role_assignments?user.id=eb9b8e4dd597472699dc3c724c4464a0&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=d535a679597c4f65b406da0e467bae95 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:05.827151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd66a7-9f92-4672-a64e-c3457bf5fe54 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:05.873314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a43ba7-6872-441b-9abf-5e665fc38b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:05.873901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ba7-6872-441b-9abf-5e665fc38b81 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.874237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ba7-6872-441b-9abf-5e665fc38b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.874515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a43ba7-6872-441b-9abf-5e665fc38b81 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.875184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a43ba7-6872-441b-9abf-5e665fc38b81 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:05.875523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a43ba7-6872-441b-9abf-5e665fc38b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:05.876963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a43ba7-6872-441b-9abf-5e665fc38b81 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:05.883644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 470/917] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Sep 26 12:14:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:05.890195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:05.987293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99819a-e068-457c-b97c-6808645c84bc None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.987657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99819a-e068-457c-b97c-6808645c84bc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.987913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99819a-e068-457c-b97c-6808645c84bc None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:05.990105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 471/918] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:05.996744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eee27-39ef-49df-90f2-70dcdfee9cf7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:05.997029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eee27-39ef-49df-90f2-70dcdfee9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:05.997613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eee27-39ef-49df-90f2-70dcdfee9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:06.008187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24303e5b-b227-4fa8-a511-3138fad78b1c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:06.017114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-952eee27-39ef-49df-90f2-70dcdfee9cf7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:06.018328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-952eee27-39ef-49df-90f2-70dcdfee9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:06.037176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:06.055374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:06.055998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:06.058280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:06.058280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:06.058280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:06.059372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:06.107481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 472/919] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:06.178867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 448/920] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:14:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:06.384947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eee27-39ef-49df-90f2-70dcdfee9cf7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:06.493541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eee27-39ef-49df-90f2-70dcdfee9cf7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:06.537135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:06.538824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:06.538824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:06.538824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:06.539179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:06.540539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:06.551375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:06.552393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:06.553250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 473/921] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:06.559684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:06.588468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:06.688147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00338971-3770-4126-9e27-8fe36f0c84ef None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:06.725875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3693a-7213-4a4d-9e34-d203366130b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:06.726508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3693a-7213-4a4d-9e34-d203366130b2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:06.726852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3693a-7213-4a4d-9e34-d203366130b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:06.727131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3693a-7213-4a4d-9e34-d203366130b2 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:06.727844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3693a-7213-4a4d-9e34-d203366130b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:06.728150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3693a-7213-4a4d-9e34-d203366130b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:06.729701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3693a-7213-4a4d-9e34-d203366130b2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:06.735585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 449/922] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:06.741009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:06.759290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:06.766655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb5f9-b669-47ed-9f34-5ec89040efd9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:06.766938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb5f9-b669-47ed-9f34-5ec89040efd9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:06.767276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb5f9-b669-47ed-9f34-5ec89040efd9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:06.771442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 450/923] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:06.774344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24a46-b825-4682-ba43-84a4945c4e59 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:06.774651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24a46-b825-4682-ba43-84a4945c4e59 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:06.774940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24a46-b825-4682-ba43-84a4945c4e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:06.794177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-96f24a46-b825-4682-ba43-84a4945c4e59 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:06.795677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-96f24a46-b825-4682-ba43-84a4945c4e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:06.882401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf588fc7-4938-4707-bf71-7be82c64bcdb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:06.883519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 451/924] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:06.925436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:06.926428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:06.926921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:06.927405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:06.928245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:06.928735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:06.930296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:06.936666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 474/925] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:06.942804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24a46-b825-4682-ba43-84a4945c4e59 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:06.955871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:07.055583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24a46-b825-4682-ba43-84a4945c4e59 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:07.096093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:07.097057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:07.097523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:07.097994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:07.098931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] RBAC: Adding query filter params (interface=public, service_id=de13a493c7384866bbdc845e6bb72e52, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:07.099449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:07.101071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:07.107427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 452/926] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:14:06 2022] GET /identity/v3/endpoints?service_id=de13a493c7384866bbdc845e6bb72e52&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:07.113448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:07.180306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:07.198838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:07.240386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd8fc9-99f0-492d-ba43-b7f33d97109e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:07.269077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:07.279933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:07.285473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:07.285473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:07.285473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:07.285473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:07.285473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:07.299633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 475/927] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:14:07 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:14:07.306117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a954e-219f-47bc-85ff-575ac49b45e9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:07.348097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:07.348744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:07.349020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:07.349289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:07.349879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:07.351276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:07.361769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:07.362764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 12:14:07.363670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:07.367506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 453/928] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Sep 26 12:14:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:07.369446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:07.495449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca19b20-7d99-4ed9-8d01-5e78d1a0d980 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:07.535726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:07.536341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:07.536616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:07.536886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:07.537517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:07.537815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:07.539184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:07.541322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:07.546259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 476/929] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:07.553568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:07.669670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc97632-919a-44d8-b5cc-abeff7976a3d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:07.709972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aca2e8-04a2-46db-9c31-f94a25fb0159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:07.710578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aca2e8-04a2-46db-9c31-f94a25fb0159 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:07.710848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aca2e8-04a2-46db-9c31-f94a25fb0159 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:07.711114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aca2e8-04a2-46db-9c31-f94a25fb0159 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:07.711780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aca2e8-04a2-46db-9c31-f94a25fb0159 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:07.712075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aca2e8-04a2-46db-9c31-f94a25fb0159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:07.713484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aca2e8-04a2-46db-9c31-f94a25fb0159 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:07.719781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 454/930] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:07.728440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:07.839615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcd1c3-0013-4a71-b971-8f684788bc4e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:07.874282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c76a91-f959-4ad7-8eac-0830ed2fda0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:07.874890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76a91-f959-4ad7-8eac-0830ed2fda0d None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:07.875221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76a91-f959-4ad7-8eac-0830ed2fda0d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:07.875524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c76a91-f959-4ad7-8eac-0830ed2fda0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:07.876201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76a91-f959-4ad7-8eac-0830ed2fda0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:07.877614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c76a91-f959-4ad7-8eac-0830ed2fda0d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:08.016283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 477/931] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:14:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:08.032028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b297b-8369-4a66-9982-ebfbef3a2591 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:08.032537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b297b-8369-4a66-9982-ebfbef3a2591 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:08.033209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b297b-8369-4a66-9982-ebfbef3a2591 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:08.036851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 455/932] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:08.042549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aebed9-489b-4539-870c-77d5cbd7b154 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:08.043053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aebed9-489b-4539-870c-77d5cbd7b154 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:08.043577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aebed9-489b-4539-870c-77d5cbd7b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:08.066095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-47aebed9-489b-4539-870c-77d5cbd7b154 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:08.067325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-47aebed9-489b-4539-870c-77d5cbd7b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:08.140958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:08.167823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 478/933] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:08.464569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b297b-8369-4a66-9982-ebfbef3a2591 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:08.467858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:08.573434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51473718-c206-4f27-b8ea-89722e93eabb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:08.574051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51473718-c206-4f27-b8ea-89722e93eabb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:08.574411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51473718-c206-4f27-b8ea-89722e93eabb None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:08.576045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 479/934] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:08.581603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c370e-5b7a-4902-81bc-00dc8587ab53 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:08.581946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c370e-5b7a-4902-81bc-00dc8587ab53 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:08.582225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c370e-5b7a-4902-81bc-00dc8587ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:08.585837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b297b-8369-4a66-9982-ebfbef3a2591 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:08.601702 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-060c370e-5b7a-4902-81bc-00dc8587ab53 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:08.603029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-060c370e-5b7a-4902-81bc-00dc8587ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:08.639498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:08.640821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:08.641305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:08.642187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:08.657669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:08.664861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:08.665859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:08.666720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:08.669216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 456/935] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Sep 26 12:14:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:08.675636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:08.701675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 480/936] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:08.756755 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:08.798345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77600a1-3bfa-4910-987a-dff794b2394d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:08.835774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:08.836973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:08.837489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:08.838017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:08.839093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:08.839714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:08.841468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:08.851487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 457/937] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Sep 26 12:14:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:08.860464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c370e-5b7a-4902-81bc-00dc8587ab53 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:08.970126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c370e-5b7a-4902-81bc-00dc8587ab53 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:08.984886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:08.994517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.012007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.013214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.013707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.014655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.030057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.034018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:09.059517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:09.060524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:09.061403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:09.061403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:09.061403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:09.063970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 481/938] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:09.072808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.130942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5142a-6a08-4bf3-92b9-d600dd7eff7f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:09.158388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:09.174731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.176051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.176393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.176668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.177430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.178861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.181517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING keystone.server.flask.common [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 12:14:09.215560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca522f5-63a5-42b1-b33a-cc99fd22adcb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:09.225712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 12:14:09.225712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 12:14:09.225712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [parameters: {'id': '5decfe0afe3f4f35aa81e3742ec660bc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 12:14:09.225712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5decfe0afe3f4f35aa81e3742ec660bc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5decfe0afe3f4f35aa81e3742ec660bc. Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 12:14:09.244758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 26 12:14:09.245749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Sep 26 12:14:09.246718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 12:14:09.247647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 12:14:09.248997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 12:14:09.250907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': '5decfe0afe3f4f35aa81e3742ec660bc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.252814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:09.254444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5decfe0afe3f4f35aa81e3742ec660bc. Sep 26 12:14:09.256358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.258779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.258779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.258779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.258779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.259283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:09.259283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.259949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.264653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 458/939] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Sep 26 12:14:08 2022] POST /identity/v3/projects => generated 262 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:09.267803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.275409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 482/940] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:09.285152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.317110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:09.405406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ece10-cfc9-4a52-94d1-8b770af5a1d2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:09.409993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aacb5-5792-42d4-bad9-4d9e75663f1a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:09.446192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.447112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.447563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.448583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.450514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.451292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.451703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.452064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.458490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.460443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.461336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.463027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:14:09.474865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:09.476032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:09.477112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:14:09.478160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:09.479809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:14:09.481098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:09.487424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 483/942] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:14:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:09.487644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 459/942] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:09.488650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.490578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.553610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:09.604668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:09.630931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabd465-2211-4f7a-8a30-e22ce2c35c3b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:09.633275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b008be5-1ae9-4263-8cd1-89fe2b8b4cf7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:09.678938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.679971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.680530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.681061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.682063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:09.683239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.684347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998d0da-bc7f-4af5-a3d2-79e5bca4b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.685063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d0da-bc7f-4af5-a3d2-79e5bca4b066 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.685441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d0da-bc7f-4af5-a3d2-79e5bca4b066 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.685811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d0da-bc7f-4af5-a3d2-79e5bca4b066 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.686097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.686736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998d0da-bc7f-4af5-a3d2-79e5bca4b066 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:09.687139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998d0da-bc7f-4af5-a3d2-79e5bca4b066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.689068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998d0da-bc7f-4af5-a3d2-79e5bca4b066 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.706830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 484/943] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:14:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:09.719288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 460/944] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Sep 26 12:14:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:09.720860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.755014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e784-2de3-40b9-8ac4-e3ee06b5d34e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.755505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e784-2de3-40b9-8ac4-e3ee06b5d34e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.755909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e784-2de3-40b9-8ac4-e3ee06b5d34e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.758516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 461/945] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:09.765015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84f7a-ad0a-4ead-83c4-5f20b9da8c57 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.765332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84f7a-ad0a-4ead-83c4-5f20b9da8c57 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.765562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84f7a-ad0a-4ead-83c4-5f20b9da8c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.792733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-66d84f7a-ad0a-4ead-83c4-5f20b9da8c57 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:09.794410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-66d84f7a-ad0a-4ead-83c4-5f20b9da8c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:09.861086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a467-8b6e-4117-a622-553b883203e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:09.883379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 462/946] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:09.906047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:09.906702 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:09.906978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:09.907247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:09.919880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:09.921485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:09.925190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:09.939664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:09.940621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:09.941508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:09.941508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:09.941508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:09.942904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 485/947] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:09.946774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84f7a-ad0a-4ead-83c4-5f20b9da8c57 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:09.982220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:10.065157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84f7a-ad0a-4ead-83c4-5f20b9da8c57 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:10.110256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:10.111286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.111782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.112236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.113074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:10.113614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:10.115270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:10.128714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 463/948] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:10.134567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:10.167294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:10.270689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416698ce-c7e9-47da-95ac-ee1fc1adeccc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:10.305911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:10.325285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:10.325959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.326246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.326517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.329255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed058c3-a293-4cc1-8e43-3c9df9783e2c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:10.335668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:10.337341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:14:10.353149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:10.355875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:10.357709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:10.359461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 486/949] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:10.360435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:10.406074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:10.406631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.406908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.407176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.407795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:10.409185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:10.419764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:10.420950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:10.421816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 464/950] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:10.429923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:10.430359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:10.480992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fa28d-b76d-4b12-ae27-860e1324b34f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:10.521927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7cad2-357b-4c31-8ba0-1d76f18c1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:10.521927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cad2-357b-4c31-8ba0-1d76f18c1419 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.522272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cad2-357b-4c31-8ba0-1d76f18c1419 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.522363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7cad2-357b-4c31-8ba0-1d76f18c1419 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.523061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7cad2-357b-4c31-8ba0-1d76f18c1419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:10.523456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7cad2-357b-4c31-8ba0-1d76f18c1419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:10.524900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7cad2-357b-4c31-8ba0-1d76f18c1419 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:10.560656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 487/951] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:10.560656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d56dc2-82f1-45b5-8161-dbfd3f8e8837 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.560656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d56dc2-82f1-45b5-8161-dbfd3f8e8837 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.560656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d56dc2-82f1-45b5-8161-dbfd3f8e8837 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.561076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b568915-a112-4f6f-a803-e0956d852a30 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:10.561156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 488/952] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:10.561156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d56dc2-82f1-45b5-8161-dbfd3f8e8837 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:10.595643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4f393-fa95-44b0-9650-87bda15396bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:10.596263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4f393-fa95-44b0-9650-87bda15396bf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.596540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4f393-fa95-44b0-9650-87bda15396bf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.596808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4f393-fa95-44b0-9650-87bda15396bf None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.597451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4f393-fa95-44b0-9650-87bda15396bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:10.597747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4f393-fa95-44b0-9650-87bda15396bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:10.599137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4f393-fa95-44b0-9650-87bda15396bf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:10.609801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 465/953] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:10.609801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378fb5a-f70f-4954-9af1-4164b6ae48cc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.609801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378fb5a-f70f-4954-9af1-4164b6ae48cc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.609801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378fb5a-f70f-4954-9af1-4164b6ae48cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.630304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9378fb5a-f70f-4954-9af1-4164b6ae48cc None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:10.631788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9378fb5a-f70f-4954-9af1-4164b6ae48cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:10.650198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:10.724170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d56dc2-82f1-45b5-8161-dbfd3f8e8837 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:10.736142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 466/954] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:10.737717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378fb5a-f70f-4954-9af1-4164b6ae48cc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:10.752409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:10.775925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:10.777637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.778066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.778452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/eb9b8e4dd597472699dc3c724c4464a0/roles/d535a679597c4f65b406da0e467bae95` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.781448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=eb9b8e4dd597472699dc3c724c4464a0, role_id=d535a679597c4f65b406da0e467bae95)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:10.783095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:10.869405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378fb5a-f70f-4954-9af1-4164b6ae48cc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:10.892091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 489/955] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:14:10 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/eb9b8e4dd597472699dc3c724c4464a0/roles/d535a679597c4f65b406da0e467bae95 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:14:10.917416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:10.918522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:10.919016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:10.919519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:10.920381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:10.920837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:10.922467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:10.930497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 467/956] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:10.936946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:11.047020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:11.062242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:11.069302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164c48f-fad3-4172-80c3-4b50e447f26c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:11.116722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:11.117581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:11.118027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:11.118332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:11.118985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:11.120933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:11.176216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05740315-1054-4460-9205-665fe59c79d9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:11.211877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 490/957] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:14:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:11.235856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:11.236696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:11.236978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:11.237296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:11.237951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:11.239470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:11.250392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:11.251746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:11.252847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 468/958] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:11.260268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:11.300052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:11.380232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c395a22-0223-476c-9e04-4659f6a14cc8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:11.419757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e438645-3086-4c17-8cb1-f48a2afc3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:11.420394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e438645-3086-4c17-8cb1-f48a2afc3b1c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:11.420646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e438645-3086-4c17-8cb1-f48a2afc3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:11.420918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e438645-3086-4c17-8cb1-f48a2afc3b1c None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:11.421553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e438645-3086-4c17-8cb1-f48a2afc3b1c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:11.421850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e438645-3086-4c17-8cb1-f48a2afc3b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:11.423202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e438645-3086-4c17-8cb1-f48a2afc3b1c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:11.428594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 491/959] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:14:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:11.434796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:11.515920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:11.549810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc2dd5-2529-421f-acc0-b3d605be9bb9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:11.587611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc4d18-733e-47bf-b724-4c25f8014743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:11.588135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4d18-733e-47bf-b724-4c25f8014743 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:11.588413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4d18-733e-47bf-b724-4c25f8014743 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:11.588742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4d18-733e-47bf-b724-4c25f8014743 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:11.589381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc4d18-733e-47bf-b724-4c25f8014743 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:11.589676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc4d18-733e-47bf-b724-4c25f8014743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:11.591049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc4d18-733e-47bf-b724-4c25f8014743 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:11.596252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 469/960] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:14:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:12.123436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe53eac-761f-48f3-bdd2-bd43991c9b53 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:12.124015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe53eac-761f-48f3-bdd2-bd43991c9b53 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:12.124015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe53eac-761f-48f3-bdd2-bd43991c9b53 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:12.125580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 492/961] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:12.131135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317d04e-e9cd-498c-8df4-d1a26c1c8f1e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:12.131644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317d04e-e9cd-498c-8df4-d1a26c1c8f1e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:12.131729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317d04e-e9cd-498c-8df4-d1a26c1c8f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:12.151978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3317d04e-e9cd-498c-8df4-d1a26c1c8f1e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:12.153187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3317d04e-e9cd-498c-8df4-d1a26c1c8f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:12.235418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 470/962] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:12.511387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe53eac-761f-48f3-bdd2-bd43991c9b53 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:12.619116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:12.628000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe53eac-761f-48f3-bdd2-bd43991c9b53 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:12.663916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:12.665087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:12.665541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:12.665965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:12.667506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:12.669110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:12.671922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING keystone.server.flask.common [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 12:14:12.705570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.sql.core [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 12:14:12.705570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 12:14:12.705570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [parameters: {'user_id': 'da2d7c06013b49749903d8fb82ca4951', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 12:14:12.705570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Sep 26 12:14:12.713039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 12:14:12.714848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application yield resource Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise self.value Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application session.commit() Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 12:14:12.716124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.flush() Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application compat.raise_( Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 12:14:12.717248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 12:14:12.718300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 12:14:12.719216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [parameters: {'user_id': 'da2d7c06013b49749903d8fb82ca4951', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:12.720072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 26 12:14:12.721019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 26 12:14:12.722006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 26 12:14:12.722006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 26 12:14:12.722006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 12:14:12.722006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 12:14:12.722006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 12:14:12.722006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:12.724072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 493/963] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Sep 26 12:14:12 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:12.730966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317d04e-e9cd-498c-8df4-d1a26c1c8f1e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:12.807417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:12.849646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317d04e-e9cd-498c-8df4-d1a26c1c8f1e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:12.885714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7174e7f-8976-4843-9668-d63c05481ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:12.886512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174e7f-8976-4843-9668-d63c05481ded None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:12.887049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174e7f-8976-4843-9668-d63c05481ded None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:12.887538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7174e7f-8976-4843-9668-d63c05481ded None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:12.899713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7174e7f-8976-4843-9668-d63c05481ded None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:12.901772 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7174e7f-8976-4843-9668-d63c05481ded None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b7174e7f-8976-4843-9668-d63c05481ded None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:14:12.914431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:12.915622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:12.917336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 471/964] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:14:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:12.922558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:13.038827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef6236-918d-4a6b-8f9a-88ffb3560375 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:13.082643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cc106-3e6a-4241-958f-32937595dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:13.082643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cc106-3e6a-4241-958f-32937595dd83 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.082643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cc106-3e6a-4241-958f-32937595dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.082643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cc106-3e6a-4241-958f-32937595dd83 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:13.083142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cc106-3e6a-4241-958f-32937595dd83 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:13.083142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cc106-3e6a-4241-958f-32937595dd83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:13.083589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cc106-3e6a-4241-958f-32937595dd83 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:13.129508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 494/965] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Sep 26 12:14:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:13.207798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7f402-40d0-49d8-9e44-ba5361095dd3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.208329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7f402-40d0-49d8-9e44-ba5361095dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.208329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7f402-40d0-49d8-9e44-ba5361095dd3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:13.210059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 472/966] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:13.216712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcbb4b-226a-415e-88d6-8a1d738ceec6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.217304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcbb4b-226a-415e-88d6-8a1d738ceec6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.217729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcbb4b-226a-415e-88d6-8a1d738ceec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:13.239615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-49fcbb4b-226a-415e-88d6-8a1d738ceec6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:13.241556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-49fcbb4b-226a-415e-88d6-8a1d738ceec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:13.259407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:13.329289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 495/967] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:13.614285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7f402-40d0-49d8-9e44-ba5361095dd3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:13.642666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3dbc5-e1ba-40a3-b318-44aefe9d55d9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.643037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3dbc5-e1ba-40a3-b318-44aefe9d55d9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.643216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3dbc5-e1ba-40a3-b318-44aefe9d55d9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:13.644592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 496/968] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:13.650339 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eabcd6-e221-495b-8d2e-daca372fcba1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.650636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eabcd6-e221-495b-8d2e-daca372fcba1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.651594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eabcd6-e221-495b-8d2e-daca372fcba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:13.670193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-65eabcd6-e221-495b-8d2e-daca372fcba1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:13.671406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-65eabcd6-e221-495b-8d2e-daca372fcba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:13.729107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7f402-40d0-49d8-9e44-ba5361095dd3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:13.747941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 497/969] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:13.765005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:13.781687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec11b2-7fee-4d04-b948-a886a4e28f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:13.782737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec11b2-7fee-4d04-b948-a886a4e28f57 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.783492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec11b2-7fee-4d04-b948-a886a4e28f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.783638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec11b2-7fee-4d04-b948-a886a4e28f57 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:13.798567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec11b2-7fee-4d04-b948-a886a4e28f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3dec11b2-7fee-4d04-b948-a886a4e28f57 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:13.803648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:13.804646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:13.805527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:13.811012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eabcd6-e221-495b-8d2e-daca372fcba1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:13.811823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 473/970] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Sep 26 12:14:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:13.945550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:13.975796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6568d-f8c0-49d5-a6b5-7c5f5ed6509d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.976658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6568d-f8c0-49d5-a6b5-7c5f5ed6509d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.976946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6568d-f8c0-49d5-a6b5-7c5f5ed6509d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:13.978093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eabcd6-e221-495b-8d2e-daca372fcba1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:13.978383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 474/971] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:13.987271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d8d2-1f5b-4498-9887-781b53ed2c11 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:13.987271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d8d2-1f5b-4498-9887-781b53ed2c11 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:13.987753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d8d2-1f5b-4498-9887-781b53ed2c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.008567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9863d8d2-1f5b-4498-9887-781b53ed2c11 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:14.010112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9863d8d2-1f5b-4498-9887-781b53ed2c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:14.031153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.033183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.033701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.033815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.034429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:14.034731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.036725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.046028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 498/972] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Sep 26 12:14:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:14.046786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.111368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 475/973] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:14.111368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d8d2-1f5b-4498-9887-781b53ed2c11 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.179371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3ca5-8e36-4754-be89-0fc5ebf042c5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.219001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.219601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.219887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.220317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.220959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.222675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.227000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d8d2-1f5b-4498-9887-781b53ed2c11 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:14.232070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:14.233164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:14.235941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 499/974] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:14.239461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.243263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:14.253840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:14.275793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.276475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.276750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.277020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.287695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.289148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:14.304484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:14.305525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:14.306422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:14.306422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:14.306422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:14.306422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 476/975] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:14.312248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.360358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbce99-d3ce-48e4-9a3a-7a8ada6d67c8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.397513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.398122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.398401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.398671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.399302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:14.399636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.401008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.406283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 500/976] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:14.407047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.428697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3995e-a0d8-40e0-b869-982edafff702 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.465674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.466283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.466559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.466891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.467580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:14.467885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.469332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.474845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:14.482462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 477/977] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:14.496825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.512981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:14.522085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476407-73cd-42c9-a7c6-a4dea70225e0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.557151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.558280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.558558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.558836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.559524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.560887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.588494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d028cd-e6be-49db-baf5-47d65ff00fc9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.623941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.624553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.624839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.625112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.625749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:14.626054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.627511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.632699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 478/978] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:14.633531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.642649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 501/979] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:14:14 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:14.643870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.753969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:14.764774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1a83b-22e4-45b6-908a-828f45a1a9a0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.789789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5be03d-17d7-4515-bd48-700d423fe370 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.812343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.813008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.813291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.813568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.821806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.823388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:14.823609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:14:14.837521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:14.840616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 12:14:14.841760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:14.842321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26438122-23b1-421a-b611-381778e104e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:14.842418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 479/980] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:14.842496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438122-23b1-421a-b611-381778e104e7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:14.842496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438122-23b1-421a-b611-381778e104e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:14.842496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438122-23b1-421a-b611-381778e104e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:14.842496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26438122-23b1-421a-b611-381778e104e7 None admin] RBAC: Adding query filter params (interface=admin, service_id=de13a493c7384866bbdc845e6bb72e52, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:14.842496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26438122-23b1-421a-b611-381778e104e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:14.842982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26438122-23b1-421a-b611-381778e104e7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:14.845534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.849036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 502/981] 10.222.0.49 () {56 vars in 1249 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/endpoints?service_id=de13a493c7384866bbdc845e6bb72e52&interface=admin®ion_id=RegionOne => generated 193 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:14.856862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26438122-23b1-421a-b611-381778e104e7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:14.977327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67966b5a-b2f0-46e1-9db0-ae05ea911412 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:14.997993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26438122-23b1-421a-b611-381778e104e7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:15.032983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:15.034036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:15.034506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:15.035102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:15.036665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:15.037259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:15.039860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:15.054167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:15.055005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:15.055498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:15.056081 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:15.056774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:15.058944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:15.072506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 503/982] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/services => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:14:15.076950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 480/983] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Sep 26 12:14:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:15.084722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:15.159159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:15.218541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188387a-e20e-4b82-91ac-7b2583f87396 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:15.259583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:15.259930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:15.260695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:15.260992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:15.341161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:15.342541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:15.399236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:15.464454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 504/984] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:15 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:14:15.466188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:15.477724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:15.584637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4af602-d23d-4802-a5b9-1fea9cfe1f45 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:15.633327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:15.633969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:15.634241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:15.634513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:15.646507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:15.647998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:15.662992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:15.664278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:15.665258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:15.665258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:15.665258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:15.667701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 481/985] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:15.670335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:15.781702 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf001e-20bc-4545-b31a-26032b7853e1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:15.819385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:15.820003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:15.820282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:15.820555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:15.821213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:15.821516 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:15.823811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:15.842008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 505/986] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:15.843891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:15.915295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:15.965804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff7d3-2502-4e1f-ba7a-8dd568bb49e9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:16.003612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:16.004278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:16.004556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:16.004830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:16.013328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:16.014819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:14:16.027542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:16.028499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:16.029482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:16.031683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 482/987] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:16.034640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:16.048616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:16.146169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9879d-a879-43b0-a250-421ffa77904b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:16.200032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfcd03-2a79-4faf-886a-66623ecb5823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:16.200973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfcd03-2a79-4faf-886a-66623ecb5823 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:16.201461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfcd03-2a79-4faf-886a-66623ecb5823 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:16.201955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfcd03-2a79-4faf-886a-66623ecb5823 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:16.203269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfcd03-2a79-4faf-886a-66623ecb5823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:16.203871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfcd03-2a79-4faf-886a-66623ecb5823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:16.206644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfcd03-2a79-4faf-886a-66623ecb5823 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:16.230097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 506/988] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:16.238689 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:16.399628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff21151-5533-485b-acd8-3d8f66edf7e7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:16.426908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:16.443515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a64740-64c2-46b7-9dd8-bac8f17040da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:16.444132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64740-64c2-46b7-9dd8-bac8f17040da None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:16.444407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64740-64c2-46b7-9dd8-bac8f17040da None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:16.444932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a64740-64c2-46b7-9dd8-bac8f17040da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:16.445394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a64740-64c2-46b7-9dd8-bac8f17040da None admin] RBAC: Adding query filter params (role.id=d535a679597c4f65b406da0e467bae95, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=eb9b8e4dd597472699dc3c724c4464a0) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:16.445698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a64740-64c2-46b7-9dd8-bac8f17040da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:16.447122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a64740-64c2-46b7-9dd8-bac8f17040da None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:16.458416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 483/989] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:16 2022] GET /identity/v3/role_assignments?user.id=eb9b8e4dd597472699dc3c724c4464a0&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=d535a679597c4f65b406da0e467bae95 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:16.923869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd71b-8b89-4dab-a20e-0a709e62a3c1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:16.924210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd71b-8b89-4dab-a20e-0a709e62a3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:16.924421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fd71b-8b89-4dab-a20e-0a709e62a3c1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:16.925933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 507/990] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:16.931218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18c130-25c9-445e-90c3-2bf0f3851bad None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:16.931852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18c130-25c9-445e-90c3-2bf0f3851bad None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:16.931852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18c130-25c9-445e-90c3-2bf0f3851bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:16.952086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1d18c130-25c9-445e-90c3-2bf0f3851bad None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:16.953293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1d18c130-25c9-445e-90c3-2bf0f3851bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:17.041337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 484/991] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:17.314098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fd71b-8b89-4dab-a20e-0a709e62a3c1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:17.355410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6e85-187e-4208-9a0d-70732abdcdb2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:17.355826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6e85-187e-4208-9a0d-70732abdcdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:17.356089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6e85-187e-4208-9a0d-70732abdcdb2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:17.357752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 485/992] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:17.363257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d139f-cfe3-4f79-90d8-c352674e775c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:17.363652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d139f-cfe3-4f79-90d8-c352674e775c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:17.363839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d139f-cfe3-4f79-90d8-c352674e775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:17.382937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-499d139f-cfe3-4f79-90d8-c352674e775c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:17.384236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-499d139f-cfe3-4f79-90d8-c352674e775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:17.392199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:17.434105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fd71b-8b89-4dab-a20e-0a709e62a3c1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:17.464351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 486/993] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:17.475569 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:17.476212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:17.476489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:17.476762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:17.477371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:17.478782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:17.489285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:17.490564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:17.491429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:17.495631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 508/994] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:17.497459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d139f-cfe3-4f79-90d8-c352674e775c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:17.552219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:17.625400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d139f-cfe3-4f79-90d8-c352674e775c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:17.666039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:17.667193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:17.667716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:17.668134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:17.668782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:17.669085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:17.670465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:17.675972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 487/995] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:14:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:17.681604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:17.745950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:17.806536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6aa61-97f4-4826-89af-1d81d315286d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:17.848148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:17.848757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:17.849031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:17.849307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:17.849932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:17.850233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:17.851619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:17.852969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:17.858747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 509/996] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:14:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:17.865085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:17.872589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85d57-789c-4e74-b8fd-8a769f5ce52f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:17.882366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:17.909120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:17.910155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:17.911152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:17.911649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:17.912520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:17.914051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:17.924964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:17.927547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:17.928465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 488/997] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Sep 26 12:14:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:17.932727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:17.981352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63de34-1f89-4df6-be8d-4d48ea1a9548 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:18.017075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:18.017682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:18.017959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:18.018241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:18.018930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] RBAC: Adding query filter params (interface=public, service_id=9f2e4c6408da4b308afbfb6d4813672e, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:18.019241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:18.020721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:18.026736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 510/998] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:14:17 2022] GET /identity/v3/endpoints?service_id=9f2e4c6408da4b308afbfb6d4813672e&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:18.032388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:18.049454 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1259dc-7aff-4294-85d3-5cab107b7442 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:18.091658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:18.092277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:18.092547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:18.092932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:18.093462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:18.093765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:18.095161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:18.106093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 489/999] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:18.106816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:18.108797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:18.148506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:18.154922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc22b1b-3aba-4371-a0ab-069d7c1adfca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:18.195503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:18.196137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:18.196415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:18.196689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:18.197309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:18.199501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:18.207379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 511/1000] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:14:18 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:14:18.237771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68c39-7dbb-4bdb-ae68-952c24433f45 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:18.278895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6bd9f-4a3e-49f5-a85f-3efba01dacd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:18.279555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6bd9f-4a3e-49f5-a85f-3efba01dacd9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:18.279835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6bd9f-4a3e-49f5-a85f-3efba01dacd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:18.280105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6bd9f-4a3e-49f5-a85f-3efba01dacd9 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:18.280751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6bd9f-4a3e-49f5-a85f-3efba01dacd9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:18.281054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6bd9f-4a3e-49f5-a85f-3efba01dacd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:18.282663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6bd9f-4a3e-49f5-a85f-3efba01dacd9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:18.294062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 490/1001] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Sep 26 12:14:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:18.295406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:18.416151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d9d55-ea3b-47cf-9f8c-315c3d388524 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:18.444468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:18.453642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e913-83f3-4eab-b8fb-68538e99ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:18.454271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e913-83f3-4eab-b8fb-68538e99ddfe None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:18.454542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e913-83f3-4eab-b8fb-68538e99ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:18.454816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e913-83f3-4eab-b8fb-68538e99ddfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:18.455542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3e913-83f3-4eab-b8fb-68538e99ddfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:18.456926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3e913-83f3-4eab-b8fb-68538e99ddfe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:18.579913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 512/1002] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:14:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:18.742437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412445-971d-4c2f-8667-6cd62b5d7f74 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:18.742635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412445-971d-4c2f-8667-6cd62b5d7f74 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:18.742941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71412445-971d-4c2f-8667-6cd62b5d7f74 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:18.745070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 491/1003] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:18.750808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34100ab-79e1-4155-96ab-74f4a32c5ce6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:18.751150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34100ab-79e1-4155-96ab-74f4a32c5ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:18.751369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34100ab-79e1-4155-96ab-74f4a32c5ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:18.772264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b34100ab-79e1-4155-96ab-74f4a32c5ce6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:18.773610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b34100ab-79e1-4155-96ab-74f4a32c5ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:18.878907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 513/1004] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:19.161833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71412445-971d-4c2f-8667-6cd62b5d7f74 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:19.267195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:19.271597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71412445-971d-4c2f-8667-6cd62b5d7f74 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:19.309172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:19.309851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:19.310081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:19.310350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] PATH_INFO: `/v3/services/image` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:19.310930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:19.312353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:19.321171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:19.322186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:19.323662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:19.327695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 492/1005] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Sep 26 12:14:19 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:19.328962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34100ab-79e1-4155-96ab-74f4a32c5ce6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:19.434103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34100ab-79e1-4155-96ab-74f4a32c5ce6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:19.448577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:19.470920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74436ff4-b4df-4dcc-bb3e-c83b7e726874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:19.471557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436ff4-b4df-4dcc-bb3e-c83b7e726874 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:19.471837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436ff4-b4df-4dcc-bb3e-c83b7e726874 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:19.472107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74436ff4-b4df-4dcc-bb3e-c83b7e726874 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:19.472735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74436ff4-b4df-4dcc-bb3e-c83b7e726874 None admin] RBAC: Adding query filter params (name=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:19.473038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74436ff4-b4df-4dcc-bb3e-c83b7e726874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:19.474638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74436ff4-b4df-4dcc-bb3e-c83b7e726874 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:19.480944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 514/1006] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:19.486476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:19.598978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a1b7-050f-4e44-a588-e5f2a003f685 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:19.634546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bf782-1036-49a4-b5a7-a513d3d4c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:19.634751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bf782-1036-49a4-b5a7-a513d3d4c16b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:19.634963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bf782-1036-49a4-b5a7-a513d3d4c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:19.635241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bf782-1036-49a4-b5a7-a513d3d4c16b None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:19.636094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bf782-1036-49a4-b5a7-a513d3d4c16b None admin] RBAC: Adding query filter params (type=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:19.636398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bf782-1036-49a4-b5a7-a513d3d4c16b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:19.638039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bf782-1036-49a4-b5a7-a513d3d4c16b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:19.642712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 493/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:20.450784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7e235-d466-4867-8e61-a63ff6d53ea8 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:20.451319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7e235-d466-4867-8e61-a63ff6d53ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:20.451319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7e235-d466-4867-8e61-a63ff6d53ea8 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:20.452833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 515/1008] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:20.457997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4b55-3ced-4ed6-b9c2-388f77dd54f2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:20.458417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4b55-3ced-4ed6-b9c2-388f77dd54f2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:20.458588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda4b55-3ced-4ed6-b9c2-388f77dd54f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:20.476925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0bda4b55-3ced-4ed6-b9c2-388f77dd54f2 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:20.478097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0bda4b55-3ced-4ed6-b9c2-388f77dd54f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:20.502453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:20.551383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 494/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:20.822336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7e235-d466-4867-8e61-a63ff6d53ea8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:20.845421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fb59f-f637-40fb-ac17-7c4ed3f267ff None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:20.845715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fb59f-f637-40fb-ac17-7c4ed3f267ff None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:20.845995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fb59f-f637-40fb-ac17-7c4ed3f267ff None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:20.847634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 495/1010] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:20.852589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadac48-6516-4368-bcea-b8fa72c7d9a3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:20.852871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadac48-6516-4368-bcea-b8fa72c7d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:20.853143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadac48-6516-4368-bcea-b8fa72c7d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:20.871832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6eadac48-6516-4368-bcea-b8fa72c7d9a3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:20.873274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6eadac48-6516-4368-bcea-b8fa72c7d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:20.938034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7e235-d466-4867-8e61-a63ff6d53ea8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:20.944754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 496/1011] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:20.976304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:20.976935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:20.977213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:20.977484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:20.978066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:20.980412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:20.989798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:20.990820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:20.991705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 516/1012] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:20.998102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadac48-6516-4368-bcea-b8fa72c7d9a3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:21.098564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:21.112059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadac48-6516-4368-bcea-b8fa72c7d9a3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:21.150277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:21.151048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:21.151563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:21.151841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:21.152477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:21.152781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:21.154149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:21.159282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 497/1013] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:14:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:21.164738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:21.214296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:21.219655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:21.302212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fd3a-0886-4a4c-9ca7-85ec373d732c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:21.341461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286c46f-a268-4050-a22a-9a59508cd851 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:21.344927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:21.345549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:21.345830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:21.346108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:21.346758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:21.347061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:21.348495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:21.359476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 517/1014] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Sep 26 12:14:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:21.364951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:21.390993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:21.391673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:21.391948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:21.392221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:21.393349 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:21.394794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:21.396578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 498/1015] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:21.402945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:21.426832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:21.475485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71557615-1dde-4b97-a4cd-2039c9106382 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:21.479102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:21.513268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a036b5-861a-46d1-a2c0-663b898c636c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:21.514425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd8ffa-6ee8-411b-ac1f-28909ee26c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:21.515157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd8ffa-6ee8-411b-ac1f-28909ee26c2a None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:21.515469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd8ffa-6ee8-411b-ac1f-28909ee26c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:21.515858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd8ffa-6ee8-411b-ac1f-28909ee26c2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:21.516532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd8ffa-6ee8-411b-ac1f-28909ee26c2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:21.517960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd8ffa-6ee8-411b-ac1f-28909ee26c2a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:21.562953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4c103-5711-4811-95e4-75b496418d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:21.563617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c103-5711-4811-95e4-75b496418d8c None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:21.563898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c103-5711-4811-95e4-75b496418d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:21.564171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4c103-5711-4811-95e4-75b496418d8c None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:21.564833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4c103-5711-4811-95e4-75b496418d8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:21.566270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4c103-5711-4811-95e4-75b496418d8c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:21.638464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 518/1016] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:14:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:21.675574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 499/1017] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:14:21 2022] POST /identity/v3/projects => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:21.841555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5abb-c520-497a-8d6e-77f9bf5022a7 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:21.841839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5abb-c520-497a-8d6e-77f9bf5022a7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:21.842111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e5abb-c520-497a-8d6e-77f9bf5022a7 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:21.843499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 519/1018] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:21.849348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d1f7-f871-4db4-a780-838bb1288de5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:21.849635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d1f7-f871-4db4-a780-838bb1288de5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:21.849913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752d1f7-f871-4db4-a780-838bb1288de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:21.871565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a752d1f7-f871-4db4-a780-838bb1288de5 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:21.873028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a752d1f7-f871-4db4-a780-838bb1288de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:21.952705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:21.960005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 500/1019] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:21 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:22.234850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e5abb-c520-497a-8d6e-77f9bf5022a7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:22.343848 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e5abb-c520-497a-8d6e-77f9bf5022a7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:22.379270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c906114-877e-4dc9-b26d-71f8c34f4daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:22.379921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906114-877e-4dc9-b26d-71f8c34f4daa None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:22.380261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906114-877e-4dc9-b26d-71f8c34f4daa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:22.380544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906114-877e-4dc9-b26d-71f8c34f4daa None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:22.381248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c906114-877e-4dc9-b26d-71f8c34f4daa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:22.382606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c906114-877e-4dc9-b26d-71f8c34f4daa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:22.507479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 520/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:14:22 2022] POST /identity/v3/services => generated 242 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:23.953819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026b90c-e298-45ed-ac06-ace15c88d4c6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:23.954350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026b90c-e298-45ed-ac06-ace15c88d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:23.954350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026b90c-e298-45ed-ac06-ace15c88d4c6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:23.956095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 501/1021] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:23.961571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee3e5-5d79-4729-a0da-74794926609b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:23.961999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee3e5-5d79-4729-a0da-74794926609b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:23.962121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee3e5-5d79-4729-a0da-74794926609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:23.982306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-901ee3e5-5d79-4729-a0da-74794926609b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:23.983543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-901ee3e5-5d79-4729-a0da-74794926609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:24.004545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:24.018083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361dd78-e08a-4445-b8fc-11f480c249c8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.018390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361dd78-e08a-4445-b8fc-11f480c249c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.018759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361dd78-e08a-4445-b8fc-11f480c249c8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.020068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 502/1022] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:24.025232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e165f-9695-4d8e-b9c5-0e3f7145c949 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.027178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e165f-9695-4d8e-b9c5-0e3f7145c949 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.027178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e165f-9695-4d8e-b9c5-0e3f7145c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.046875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fa5e165f-9695-4d8e-b9c5-0e3f7145c949 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:24.048397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fa5e165f-9695-4d8e-b9c5-0e3f7145c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:24.072602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 521/1023] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:24.132472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 503/1024] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:24.342891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ee3e5-5d79-4729-a0da-74794926609b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:24.412173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e165f-9695-4d8e-b9c5-0e3f7145c949 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:24.447119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ee3e5-5d79-4729-a0da-74794926609b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:24.486989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:24.487815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.488093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.488375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.489486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:24.490914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:24.497310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 522/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:24.500260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:24.520162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:24.529009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e165f-9695-4d8e-b9c5-0e3f7145c949 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:24.558674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:24.566280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:24.566918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.567194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.567498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.578955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:24.584209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:24.585169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:24.585994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:24.590955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 504/1026] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Sep 26 12:14:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:24.592237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:24.617342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26000a-d3b6-4dea-9647-198cc77688aa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:24.667681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:24.668294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.668568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.668830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.669486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:24.670903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:24.714693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d64d1-91c0-42d5-b38f-a0c20679c1f4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:24.750382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd448054-9400-4766-b4c2-9e5ab6ffb6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:24.750987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd448054-9400-4766-b4c2-9e5ab6ffb6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.751261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd448054-9400-4766-b4c2-9e5ab6ffb6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.751555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd448054-9400-4766-b4c2-9e5ab6ffb6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.752215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd448054-9400-4766-b4c2-9e5ab6ffb6f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:24.752542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd448054-9400-4766-b4c2-9e5ab6ffb6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:24.753897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd448054-9400-4766-b4c2-9e5ab6ffb6f2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:24.763444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 505/1027] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Sep 26 12:14:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:24.763762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 523/1028] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:14:24 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:24.765027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ab2cc-83e6-4249-af7c-2c2414e1e72b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.765490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ab2cc-83e6-4249-af7c-2c2414e1e72b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.766318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ab2cc-83e6-4249-af7c-2c2414e1e72b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.769677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:24.771959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 506/1029] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:24.773225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1299-797d-4ead-a636-133ec2a7b8fa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.773563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1299-797d-4ead-a636-133ec2a7b8fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.773853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d1299-797d-4ead-a636-133ec2a7b8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.796046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-342d1299-797d-4ead-a636-133ec2a7b8fa None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:24.797973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-342d1299-797d-4ead-a636-133ec2a7b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:24.870728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:24.872479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:24.897417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 507/1030] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:24.911476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413da3f7-8587-463d-b56c-daac617bdfce None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:24.965312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:24.966083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:24.966310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:24.966548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:24.980009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:24.981556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:25.000243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:25.001231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:25.002128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:25.002128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:25.002128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:25.002128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 524/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:25.007372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d1299-797d-4ead-a636-133ec2a7b8fa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.116005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d1299-797d-4ead-a636-133ec2a7b8fa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.152714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.153253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.153534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.153804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.154450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:25.154756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.156153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.173477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 508/1032] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:25.175159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.180580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.229810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:25.284723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab360e7-9fc9-4503-b80f-000181d4e5ba None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.296660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6605b-73a9-4230-9851-365a687d9eaa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.311656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:25.323896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.328213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.328213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.328213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.334079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.335564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.336873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.337520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.337802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.338755 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.339470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.340842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:14:25.348715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:25.349732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:14:25.350704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:25.351265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:25.358255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:25.359075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 509/1033] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:25.359904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 525/1034] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:25.359977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.360058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.469184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90011b-263a-4223-bddf-4983f1744327 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.474082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2422f59-2485-4d81-94f5-418b682016e4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.476527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:25.506593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.507201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.507513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.507787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.508418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] RBAC: Adding query filter params (name=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:25.508722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.510143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.512919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.513532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.513812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.514085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.514817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:25.515123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.517237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.521253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 526/1035] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:25.522201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.544011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 510/1036] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:25.545210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.576777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:25.637097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8897-2042-4226-86e0-7fe47cb11682 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.654378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d080aa1-438d-4b92-b08f-b08402384534 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.672255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.672860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.673138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.673406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.674036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] RBAC: Adding query filter params (type=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:25.674333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.675784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.683203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 527/1037] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:25.689337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.693607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.694224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.694504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.694779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.729666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:25.772375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.774346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.798766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b334bfe-31f3-4f29-8d44-726addfa7b1a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:25.811106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:25.851104 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:25.851742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:25.852176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:25.852449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:25.853153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] RBAC: Adding query filter params (interface=public, service_id=8907147fbf114ea2981f432119b8c693, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:25.853457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:25.855533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:25.860900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 528/1038] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/endpoints?service_id=8907147fbf114ea2981f432119b8c693&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:25.866654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.893081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 511/1039] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 12:14:25.898605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:25.971794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:25.981404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e43d3-ab2f-4148-9740-d95b6bbaf096 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:26.020318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f2001-b092-4010-8f66-6b70d3dae508 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:26.021947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:26.022560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:26.022905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:26.023187 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:26.023825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:26.025242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:26.033387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 529/1040] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:14:26.072978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:26.073691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:26.074008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:26.074180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:26.088652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:26.090324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:26.107405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:26.108446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:26.109368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:26.109368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:26.109368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:26.110184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 512/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:26.114574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:26.173539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:26.243044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07984171-008e-4fda-a416-76a4a0b2885f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:26.283641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:26.284639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:26.285151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:26.285638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:26.286485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:26.286990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:26.288581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:26.301367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 530/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:26.307546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:26.413692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e000960-3617-4ccc-8088-d1a04c20dd0e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:26.428744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:26.450910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:26.451579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:26.451862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:26.452134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:26.459853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:26.461304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:14:26.473503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:26.474416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:26.475365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:26.479440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 513/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:26.481488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:26.582560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:26.587492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e3696-f529-42f8-a74b-0ff749cbe8db None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:26.623275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd8951-38e4-4aad-a56d-2988afaf3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:26.623922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd8951-38e4-4aad-a56d-2988afaf3e87 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:26.624196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd8951-38e4-4aad-a56d-2988afaf3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:26.624471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd8951-38e4-4aad-a56d-2988afaf3e87 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:26.625173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd8951-38e4-4aad-a56d-2988afaf3e87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:26.625478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd8951-38e4-4aad-a56d-2988afaf3e87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:26.626914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd8951-38e4-4aad-a56d-2988afaf3e87 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:26.641250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 531/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:14:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:26.647579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:26.759055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ef833-3030-4ca2-8c63-36273d0295a7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:26.797994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d76581-26d0-45eb-83cf-4ad502fc2e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:26.798601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d76581-26d0-45eb-83cf-4ad502fc2e2c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:26.798883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d76581-26d0-45eb-83cf-4ad502fc2e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:26.799156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d76581-26d0-45eb-83cf-4ad502fc2e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:26.799914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d76581-26d0-45eb-83cf-4ad502fc2e2c None admin] RBAC: Adding query filter params (role.id=d535a679597c4f65b406da0e467bae95, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=952c5c9a37a54497aab20652d0282690) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:26.800227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d76581-26d0-45eb-83cf-4ad502fc2e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:26.801699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d76581-26d0-45eb-83cf-4ad502fc2e2c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:26.808691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 514/1045] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:26 2022] GET /identity/v3/role_assignments?user.id=952c5c9a37a54497aab20652d0282690&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=d535a679597c4f65b406da0e467bae95 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:27.089235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034046d-77fa-4818-9d2f-f6a416c6c862 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:27.089746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034046d-77fa-4818-9d2f-f6a416c6c862 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:27.090203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034046d-77fa-4818-9d2f-f6a416c6c862 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:27.092840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 532/1046] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:27.098970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a152d-3de0-4e82-a60b-4fe67d3cfd5d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:27.099552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a152d-3de0-4e82-a60b-4fe67d3cfd5d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:27.099552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a152d-3de0-4e82-a60b-4fe67d3cfd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:27.118060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5f5a152d-3de0-4e82-a60b-4fe67d3cfd5d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:27.119781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5f5a152d-3de0-4e82-a60b-4fe67d3cfd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:27.152925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:27.203415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 515/1047] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:27.514616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034046d-77fa-4818-9d2f-f6a416c6c862 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:27.629677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034046d-77fa-4818-9d2f-f6a416c6c862 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:27.670547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:27.671686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:27.672163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:27.672629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:27.687171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:27.692648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:27.693557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:27.694392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:27.696996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 533/1048] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:27.704046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a152d-3de0-4e82-a60b-4fe67d3cfd5d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:27.837835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a152d-3de0-4e82-a60b-4fe67d3cfd5d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:27.881777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:27.882394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:27.882678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:27.882983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:27.885290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:27.885846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:27.888331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:27.905219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 516/1049] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:27.906565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:27.931194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:28.029077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fc74-340d-4d96-bb2f-38712289d77d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:28.075538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18100948-08f7-4a7a-88e3-0cfcb13b6df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:28.076484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100948-08f7-4a7a-88e3-0cfcb13b6df9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:28.076992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100948-08f7-4a7a-88e3-0cfcb13b6df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:28.077633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18100948-08f7-4a7a-88e3-0cfcb13b6df9 None admin] PATH_INFO: `/v3/users/20d84983b37544198cddafbd9b1ab9e3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:28.097481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18100948-08f7-4a7a-88e3-0cfcb13b6df9 None admin] RBAC: Authorizing `identity:get_user(user_id=20d84983b37544198cddafbd9b1ab9e3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:28.099686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18100948-08f7-4a7a-88e3-0cfcb13b6df9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:28.106599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 534/1050] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:27 2022] GET /identity/v3/users/20d84983b37544198cddafbd9b1ab9e3 => generated 285 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:28.108096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:28.147977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:28.233747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1fbc7-4b87-4042-8d65-ba31c3c3e4c7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:28.276530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:28.277258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:28.277633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:28.278017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:28.360151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc5116-a6a3-4ee7-bebc-f6fc1c0a57ba None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:28.360368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc5116-a6a3-4ee7-bebc-f6fc1c0a57ba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:28.360615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc5116-a6a3-4ee7-bebc-f6fc1c0a57ba None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:28.361596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:28.362226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 535/1051] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:28.363060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:28.367914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290d53-7de6-415e-89b6-9699d75fd40e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:28.368209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290d53-7de6-415e-89b6-9699d75fd40e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:28.368524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82290d53-7de6-415e-89b6-9699d75fd40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:28.402256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-82290d53-7de6-415e-89b6-9699d75fd40e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:28.404749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-82290d53-7de6-415e-89b6-9699d75fd40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:28.412143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:28.498803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 536/1052] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:28.504438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 517/1053] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:14:28.510777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82290d53-7de6-415e-89b6-9699d75fd40e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:28.520008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:28.617634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82290d53-7de6-415e-89b6-9699d75fd40e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:28.654625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:28.655267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:28.655576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:28.655857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:28.657007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c38676a1a63a4a3f99e91eee75f354ea)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:28.658464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:28.660526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 537/1054] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:14:28 2022] GET /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:28.667770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:28.785882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a57-ce1c-4584-a0be-6cb763a334eb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:28.821495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:28.828823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:28.829446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:28.829723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:28.830010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:28.830730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=c38676a1a63a4a3f99e91eee75f354ea, user.id=20d84983b37544198cddafbd9b1ab9e3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:28.833584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:28.833584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:28.833749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:28.843698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 518/1055] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:28 2022] GET /identity/v3/role_assignments?user.id=20d84983b37544198cddafbd9b1ab9e3&scope.project.id=c38676a1a63a4a3f99e91eee75f354ea&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:28.933564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:28.966986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe9da1-eaa5-40b8-aa3c-d3a688e8a8e3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:29.014814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:29.015512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:29.015795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:29.016068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] PATH_INFO: `/v3/services/image` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:29.016685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:29.019799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:29.028528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:29.029582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:29.030420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 538/1056] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Sep 26 12:14:28 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:29.035215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:29.153628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee9ed-bde5-472e-b73b-52b7414f2512 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:29.196070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed197ada-13b9-438b-86fd-f4e8ca079e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:29.196070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed197ada-13b9-438b-86fd-f4e8ca079e28 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:29.196347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed197ada-13b9-438b-86fd-f4e8ca079e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:29.196587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed197ada-13b9-438b-86fd-f4e8ca079e28 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:29.198305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed197ada-13b9-438b-86fd-f4e8ca079e28 None admin] RBAC: Adding query filter params (name=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:29.198305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed197ada-13b9-438b-86fd-f4e8ca079e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:29.199620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed197ada-13b9-438b-86fd-f4e8ca079e28 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:29.204996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 519/1057] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:29.210695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:29.283173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dccc-fe2c-49fc-bd44-5c441e18029d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:29.283496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dccc-fe2c-49fc-bd44-5c441e18029d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:29.283776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55dccc-fe2c-49fc-bd44-5c441e18029d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:29.285115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 520/1058] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:29.290239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77104fe5-5d13-40f0-abe9-2d8df6b64a86 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:29.290522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77104fe5-5d13-40f0-abe9-2d8df6b64a86 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:29.290799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77104fe5-5d13-40f0-abe9-2d8df6b64a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:29.310003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-77104fe5-5d13-40f0-abe9-2d8df6b64a86 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:29.311204 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-77104fe5-5d13-40f0-abe9-2d8df6b64a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:29.325303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322b90-072a-44ca-8764-6c8561297c61 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:29.366056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:29.366732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:29.366940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:29.367218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:29.367882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:29.368188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:29.369629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:29.370784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:29.375740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 539/1059] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:29.381693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:29.384526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:29.389574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 521/1060] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:29.487789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6fd05-7792-4565-bfd9-6be458aa82a4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:29.523259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:29.523896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:29.524174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:29.524443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:29.525112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:29.527291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:29.615008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 540/1061] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:14:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:14:29.700822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77104fe5-5d13-40f0-abe9-2d8df6b64a86 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:29.819973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77104fe5-5d13-40f0-abe9-2d8df6b64a86 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:29.863025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:29.863692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:29.863975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:29.864252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:29.875701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:29.880829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:29.881791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:29.882647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:29.887427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 522/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Sep 26 12:14:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:29.889373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:29.950861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:29.995206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d8183-af8a-4878-94f3-bf73e83b18a1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:30.032157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:30.032775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:30.033057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:30.033332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:30.034001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:30.034307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:30.035700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:30.050593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 541/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Sep 26 12:14:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:30.051955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:30.107845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:30.166012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b38d41-0fc0-4b6a-b2b2-4b77bd338540 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:30.202432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:30.203068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:30.203361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:30.203655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:30.215243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:30.216750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:30.232092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:30.233103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:30.234024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:30.234024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:30.234024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:30.234024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 523/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:30.240454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:30.346368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe74d67-8cc9-485b-b4fe-5349d7798989 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:30.366905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:30.381827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:30.382527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:30.382694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:30.382971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:30.383647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:30.383955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:30.386177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:30.398869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 542/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:30.404971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:30.507776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:30.514778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803061cc-ee7e-4bd8-8ed4-93f63b942951 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:30.550277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:30.551533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:30.552192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:30.553057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:30.561503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:30.563021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:14:30.576880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:30.577885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:30.578822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 524/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:14:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:30.585260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:30.688293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6f2b1-9cc7-4fa0-b24f-b69112fdb899 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:30.723423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:30.724028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:30.724306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:30.724573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:30.725326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:30.725629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:30.727049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:30.745396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 543/1067] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:14:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:30.751031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:30.866869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd7e6e-995b-497c-98fe-266bdc08fcaf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:30.905612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de40f3b-90d6-4d6b-8877-427e4fa1c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:30.906257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de40f3b-90d6-4d6b-8877-427e4fa1c4ab None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:30.906536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de40f3b-90d6-4d6b-8877-427e4fa1c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:30.906885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de40f3b-90d6-4d6b-8877-427e4fa1c4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:30.919183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de40f3b-90d6-4d6b-8877-427e4fa1c4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:30.920693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de40f3b-90d6-4d6b-8877-427e4fa1c4ab None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8de40f3b-90d6-4d6b-8877-427e4fa1c4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:30.937530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:30.940199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:30.942075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:30.942075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:30.942075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:30.943116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 525/1068] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:30.944727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:30.987885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:31.054257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34517cc-d02b-4ce3-ac28-5b75717a0ba1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:31.097489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:31.098095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.098373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.098641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.099281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:31.099618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:31.100971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:31.113178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 544/1069] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:31.118481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:31.118907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff558c-7472-41fa-b879-d230476c7777 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.119273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff558c-7472-41fa-b879-d230476c7777 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.119756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff558c-7472-41fa-b879-d230476c7777 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.121212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 526/1070] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:31.126576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2ef3a-236c-40f6-9350-eb06b8f97089 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.126865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2ef3a-236c-40f6-9350-eb06b8f97089 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.127167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2ef3a-236c-40f6-9350-eb06b8f97089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.146756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3cb2ef3a-236c-40f6-9350-eb06b8f97089 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:31.148129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3cb2ef3a-236c-40f6-9350-eb06b8f97089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:31.150334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:31.223483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 527/1071] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:31.231479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:31.236984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145a925-7856-4e61-a194-17cc702f7aeb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:31.273076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:31.274425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.274856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.275334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.282422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:31.284073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:14:31.296806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:31.297919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:31.299057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:31.301163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 545/1072] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:31.307319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2ef3a-236c-40f6-9350-eb06b8f97089 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:31.414462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2ef3a-236c-40f6-9350-eb06b8f97089 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:31.450298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:31.450913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.451196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.451502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.452193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:31.452500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:31.453932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:31.460820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:31.467300 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 528/1073] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:31.473328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:31.508997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:31.594881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8d4b-4788-4c54-bb3f-10331abc3ef2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:31.620576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f825f-46ba-4ed9-a20d-79583800027f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:31.638865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:31.639955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.640444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.640921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/952c5c9a37a54497aab20652d0282690/roles/d535a679597c4f65b406da0e467bae95` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.643485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=952c5c9a37a54497aab20652d0282690, role_id=d535a679597c4f65b406da0e467bae95)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:31.645819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:31.656182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:31.656867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.657175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.657413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.668932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:31.673703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:31.675550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:31.676598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 529/1074] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:31.681169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:31.731908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 546/1075] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:14:31 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/952c5c9a37a54497aab20652d0282690/roles/d535a679597c4f65b406da0e467bae95 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:14:31.751634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:31.805098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be0e87-90fc-4e94-90a8-2f34878968b3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:31.845749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f987d07-f72c-4aad-8050-3b02b58683fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:31.846381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987d07-f72c-4aad-8050-3b02b58683fc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.846660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987d07-f72c-4aad-8050-3b02b58683fc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.846933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987d07-f72c-4aad-8050-3b02b58683fc None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.847648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f987d07-f72c-4aad-8050-3b02b58683fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:31.847957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f987d07-f72c-4aad-8050-3b02b58683fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:31.849364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f987d07-f72c-4aad-8050-3b02b58683fc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:31.859459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 530/1076] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:31.865267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:31.888276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:31.893291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646448c6-e86f-416b-922e-fa4e9083cc2c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.893651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646448c6-e86f-416b-922e-fa4e9083cc2c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.897954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646448c6-e86f-416b-922e-fa4e9083cc2c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.897954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 531/1077] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:31.902016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c222d4-54be-4705-b1a2-919df82be106 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:31.902306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c222d4-54be-4705-b1a2-919df82be106 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:31.902581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c222d4-54be-4705-b1a2-919df82be106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:31.923160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-47c222d4-54be-4705-b1a2-919df82be106 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:31.924137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-47c222d4-54be-4705-b1a2-919df82be106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:31.988865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd06e66-c8aa-4607-9e6a-182d1044841f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:32.000058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 532/1078] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:32.034881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:32.035570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:32.035837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:32.036111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] PATH_INFO: `/v3/users/20d84983b37544198cddafbd9b1ab9e3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:32.037270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] RBAC: Authorizing `identity:get_user(user_id=20d84983b37544198cddafbd9b1ab9e3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:32.038729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:32.040698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 547/1079] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:31 2022] GET /identity/v3/users/20d84983b37544198cddafbd9b1ab9e3 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:32.048572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c222d4-54be-4705-b1a2-919df82be106 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:32.122291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:32.187691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c222d4-54be-4705-b1a2-919df82be106 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:32.225831 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:32.226513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:32.226747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:32.227000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:32.229014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] RBAC: Authorizing `identity:get_project(project_id=c38676a1a63a4a3f99e91eee75f354ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:32.230506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:32.237210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 533/1080] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:14:32 2022] GET /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea => generated 311 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:32.238435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:32.275023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:32.336291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:32.352193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81abefb-441c-4041-8707-93f7fe515796 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:32.390227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:32.390887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:32.391168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:32.391474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea/users/20d84983b37544198cddafbd9b1ab9e3/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:32.393366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] RBAC: Authorizing `identity:create_grant(project_id=c38676a1a63a4a3f99e91eee75f354ea, user_id=20d84983b37544198cddafbd9b1ab9e3, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:32.393600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8da5-d49a-4c34-8db0-888224d2b496 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:32.394793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:32.412271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:32.429484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:32.430095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:32.430370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:32.430638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:32.479430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 548/1081] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:14:32 2022] PUT /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea/users/20d84983b37544198cddafbd9b1ab9e3/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:14:32.511578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:32.513336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:32.627697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 534/1082] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 12:14:32.633585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:32.743385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c1208-e6f3-4e1a-83d7-c4ce6dfb9480 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:32.779190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b4cfe-7734-4d44-b271-959f31111656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:32.780238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b4cfe-7734-4d44-b271-959f31111656 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:32.780723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b4cfe-7734-4d44-b271-959f31111656 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:32.781211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b4cfe-7734-4d44-b271-959f31111656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:32.792091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b4cfe-7734-4d44-b271-959f31111656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:32.793776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b4cfe-7734-4d44-b271-959f31111656 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:32.800990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-269b4cfe-7734-4d44-b271-959f31111656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:32.810717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:32.811735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:32.812643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:32.812643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:32.812643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:32.813244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 549/1083] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:32.818706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:32.839845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:32.924168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fb1f5-ea24-4dbf-ae5e-deaea53294ff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:32.959251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff3c4c-f558-43b6-973f-15c4ccc410e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:32.959851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff3c4c-f558-43b6-973f-15c4ccc410e4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:32.960124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff3c4c-f558-43b6-973f-15c4ccc410e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:32.960391 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff3c4c-f558-43b6-973f-15c4ccc410e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:32.961021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff3c4c-f558-43b6-973f-15c4ccc410e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:32.961488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff3c4c-f558-43b6-973f-15c4ccc410e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:32.962795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff3c4c-f558-43b6-973f-15c4ccc410e4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:32.974907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 535/1084] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:33.957245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c86c0-ccff-4edb-b16e-f4fbae950533 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:33.957778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c86c0-ccff-4edb-b16e-f4fbae950533 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:33.957890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c86c0-ccff-4edb-b16e-f4fbae950533 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:33.959245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 550/1085] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:33.965075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5dcf0-baa2-41fb-ba09-c9eda764276a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:33.965531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5dcf0-baa2-41fb-ba09-c9eda764276a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:33.965628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5dcf0-baa2-41fb-ba09-c9eda764276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:33.984271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4bc5dcf0-baa2-41fb-ba09-c9eda764276a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:33.985452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4bc5dcf0-baa2-41fb-ba09-c9eda764276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:34.054027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 536/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:34.324035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c86c0-ccff-4edb-b16e-f4fbae950533 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:34.427000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c86c0-ccff-4edb-b16e-f4fbae950533 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:34.461198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:34.461837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:34.462129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:34.462386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:34.474479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:34.479942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:34.481018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:34.481887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 551/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Sep 26 12:14:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:34.487322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5dcf0-baa2-41fb-ba09-c9eda764276a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:34.498102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:34.603217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5dcf0-baa2-41fb-ba09-c9eda764276a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:34.641728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05953f-c89f-4de1-ae3e-abf898569098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:34.642344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05953f-c89f-4de1-ae3e-abf898569098 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:34.642620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05953f-c89f-4de1-ae3e-abf898569098 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:34.642886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05953f-c89f-4de1-ae3e-abf898569098 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:34.643593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05953f-c89f-4de1-ae3e-abf898569098 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:34.643895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05953f-c89f-4de1-ae3e-abf898569098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:34.645252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05953f-c89f-4de1-ae3e-abf898569098 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:34.654781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 537/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Sep 26 12:14:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:34.660725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:34.684355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0e21b-e954-4944-97b7-5d76d12d9ea3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:34.684634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0e21b-e954-4944-97b7-5d76d12d9ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:34.684910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0e21b-e954-4944-97b7-5d76d12d9ea3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:34.686231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 538/1089] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:14:34.691118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c2cf-2e6c-4ef8-b1cd-aa3d5aa912ca None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:34.691433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c2cf-2e6c-4ef8-b1cd-aa3d5aa912ca None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:34.691709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381c2cf-2e6c-4ef8-b1cd-aa3d5aa912ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:34.709844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4381c2cf-2e6c-4ef8-b1cd-aa3d5aa912ca None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:34.711039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4381c2cf-2e6c-4ef8-b1cd-aa3d5aa912ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:34.721011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:34.763031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea1aad-85ce-494d-9607-356942ae7a4c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:34.776217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:34.780771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 539/1090] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:14:34.797576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:34.798183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:34.798455 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:34.798719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:34.810248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:34.811718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:34.826750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:34.827985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:34.828882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:34.828882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:34.828882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:34.828882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 552/1091] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:34.833818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381c2cf-2e6c-4ef8-b1cd-aa3d5aa912ca None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:34.936068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381c2cf-2e6c-4ef8-b1cd-aa3d5aa912ca None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:34.970124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:34.970763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:34.970997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:34.971268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:34.971943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:34.972247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:34.973617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:34.985588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 540/1092] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:34.991450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.051604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.094967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6b53-bf91-47c6-bea8-9cf27a7d0a73 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.105847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.117267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.128992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.129638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.129913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.130181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.137943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.139394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:14:35.152216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:35.156412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:35.157592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 553/1093] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Sep 26 12:14:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:35.159251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.160420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f420ae-ae5b-4316-8b8a-7a79cb3e09ab None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.199736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.200723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.201220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.201697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.214583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:35.219842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:35.220959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:35.222041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:14:35.225983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 541/1094] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:35.226770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.262967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d38c81-6b04-4352-ae11-505b1abbf27b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.299310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.299954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.300232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.300508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.301279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:35.301585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.303018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.320932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 554/1095] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:35.326686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.329992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d4868-0f82-4384-910a-233ab675efbe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.350564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.356114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.369756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.370375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.373195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.373195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.373195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:35.373195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.373753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.384178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 542/1096] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:35.390577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.431224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ed251-130d-4a54-9a0a-9db43b1c09a8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.465809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.466325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.466609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.466881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.492420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8c5c-035c-4bfc-937e-4fa445b89913 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.527836 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.528482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.529063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.529334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] PATH_INFO: `/v3/users/20d84983b37544198cddafbd9b1ab9e3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.530498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] RBAC: Authorizing `identity:get_user(user_id=20d84983b37544198cddafbd9b1ab9e3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.531976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.534628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 543/1097] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/users/20d84983b37544198cddafbd9b1ab9e3 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:35.535858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.537324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.539575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.565047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.592628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.637623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 555/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 12:14:35.644745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d6087-36c7-4ad9-8891-70a11ed8135d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.647799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.683378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.684003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.684278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.684553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.755264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcf0ad-1f9a-4d9b-8c8f-b0afb6f8a1d3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.762176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.763712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.786451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.795297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.796055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.796338 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.796605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.808707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.810177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.819754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:14:35.828762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:35.836814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:14:35.839523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:14:35.839523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:14:35.839523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:35.839523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 556/1099] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:35.839523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.882817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 544/1100] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 12:14:35.890606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:35.948520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb1e11-981d-4d11-b7bc-7fa27ddaf843 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.981531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:35.982136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:35.982418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:35.982693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:35.983394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:35.983673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:35.985039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:35.991174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03f055-a37e-413a-9432-50012a9a948a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:35.997176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 557/1101] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:36.002822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:36.027598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:36.028159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:36.028438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:36.028709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:36.029822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] RBAC: Authorizing `identity:get_project(project_id=c38676a1a63a4a3f99e91eee75f354ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:36.031255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:36.037937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 545/1102] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:14:35 2022] GET /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:36.040253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:36.045191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:36.059354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:36.105239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd5f19-4317-4888-ad79-53e3ffde1ed0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:36.141717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:36.142352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:36.142625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:36.142895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:36.144632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db9440-6a12-4cf7-81f0-335ae4920e6f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:36.149735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:36.151302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:14:36.162482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:36.163904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:36.165059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 558/1103] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:14:36.169439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:36.180130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:36.180739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:36.181014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:36.181284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:36.182807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=c38676a1a63a4a3f99e91eee75f354ea, user.id=20d84983b37544198cddafbd9b1ab9e3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:36.183113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:36.184579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:36.190470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 546/1104] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:36 2022] GET /identity/v3/role_assignments?user.id=20d84983b37544198cddafbd9b1ab9e3&scope.project.id=c38676a1a63a4a3f99e91eee75f354ea&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:36.276257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:36.279712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2bdf4-6026-4c2a-a7c6-972f95741f72 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:36.318171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b2caf-0185-4b5b-b82f-f5513f2a2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:36.318793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b2caf-0185-4b5b-b82f-f5513f2a2485 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:36.319076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b2caf-0185-4b5b-b82f-f5513f2a2485 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:36.319366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b2caf-0185-4b5b-b82f-f5513f2a2485 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:36.320088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b2caf-0185-4b5b-b82f-f5513f2a2485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:36.320399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b2caf-0185-4b5b-b82f-f5513f2a2485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:36.321860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b2caf-0185-4b5b-b82f-f5513f2a2485 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:36.334703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 559/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:36.341724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:36.429810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:36.448544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a3e2d-240e-4305-988d-60a6ec86f7f6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:36.483258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf6b3f-24f9-44e3-959c-1d832524cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:36.483917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf6b3f-24f9-44e3-959c-1d832524cccb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:36.484203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf6b3f-24f9-44e3-959c-1d832524cccb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:36.484471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf6b3f-24f9-44e3-959c-1d832524cccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:36.485214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf6b3f-24f9-44e3-959c-1d832524cccb None admin] RBAC: Adding query filter params (role.id=d535a679597c4f65b406da0e467bae95, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=952c5c9a37a54497aab20652d0282690) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:36.485520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf6b3f-24f9-44e3-959c-1d832524cccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:36.486942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf6b3f-24f9-44e3-959c-1d832524cccb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:36.493241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 547/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:36 2022] GET /identity/v3/role_assignments?user.id=952c5c9a37a54497aab20652d0282690&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=d535a679597c4f65b406da0e467bae95 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:38.446761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555513-3f42-48bf-95d1-b06bc4799e0a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:38.447947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555513-3f42-48bf-95d1-b06bc4799e0a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:38.448247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555513-3f42-48bf-95d1-b06bc4799e0a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:38.450883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 560/1107] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:38.457249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849da3-5110-4f75-891e-8d947d394591 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:38.457665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849da3-5110-4f75-891e-8d947d394591 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:38.457787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849da3-5110-4f75-891e-8d947d394591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:38.476260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-94849da3-5110-4f75-891e-8d947d394591 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:38.477461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94849da3-5110-4f75-891e-8d947d394591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:38.544883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 548/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:38.811193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555513-3f42-48bf-95d1-b06bc4799e0a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:38.915553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555513-3f42-48bf-95d1-b06bc4799e0a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:38.949417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d5feb-89ab-48a0-8015-c6b1dfb35b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:38.950040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d5feb-89ab-48a0-8015-c6b1dfb35b5e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:38.950318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d5feb-89ab-48a0-8015-c6b1dfb35b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:38.950589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d5feb-89ab-48a0-8015-c6b1dfb35b5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:38.951725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d5feb-89ab-48a0-8015-c6b1dfb35b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:38.953149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d5feb-89ab-48a0-8015-c6b1dfb35b5e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:38.954709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 561/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:38.960428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94849da3-5110-4f75-891e-8d947d394591 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:39.034769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:39.057366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94849da3-5110-4f75-891e-8d947d394591 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:39.092271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9d75-7600-47ff-a683-e0982939b049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:39.092870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9d75-7600-47ff-a683-e0982939b049 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:39.093145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9d75-7600-47ff-a683-e0982939b049 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:39.093412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9d75-7600-47ff-a683-e0982939b049 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:39.094071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a9d75-7600-47ff-a683-e0982939b049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:39.095551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a9d75-7600-47ff-a683-e0982939b049 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:39.190227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 549/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:14:38 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:41.449409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e37c-2db4-498e-bfa9-772fea585c72 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:41.449972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e37c-2db4-498e-bfa9-772fea585c72 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:41.449972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084e37c-2db4-498e-bfa9-772fea585c72 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:41.451300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 562/1111] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:41.456543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6841b-3906-4801-9f25-bd02446be826 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:41.456966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6841b-3906-4801-9f25-bd02446be826 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:41.457078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6841b-3906-4801-9f25-bd02446be826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:41.476615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8cb6841b-3906-4801-9f25-bd02446be826 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:41.477797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8cb6841b-3906-4801-9f25-bd02446be826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:41.552306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 550/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:41.822312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084e37c-2db4-498e-bfa9-772fea585c72 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:41.850960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:41.924903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084e37c-2db4-498e-bfa9-772fea585c72 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:41.958795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:41.959434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:41.959710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:41.959974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] PATH_INFO: `/v3/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:41.961342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] RBAC: Authorizing `identity:get_role(role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:41.963334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:41.969309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 563/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:41 2022] GET /identity/v3/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:41.970624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6841b-3906-4801-9f25-bd02446be826 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:42.032252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:42.070506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6841b-3906-4801-9f25-bd02446be826 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:42.105815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:42.106370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:42.106649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:42.106925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] PATH_INFO: `/v3/users/d9d82b92b07e4aefa5f3468a47235fc5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:42.120774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d82b92b07e4aefa5f3468a47235fc5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:42.122231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:42.123906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 551/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:41 2022] GET /identity/v3/users/d9d82b92b07e4aefa5f3468a47235fc5 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:42.129779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:42.224029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:42.230345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f45c0-6e46-47fa-a3a5-743107c126ab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:42.263040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:42.263668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:42.263952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:42.264226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:42.330533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:42.332024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:42.422574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:42.428995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 564/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:14:42.435745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:42.541236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b506e-10a6-4ce3-ac67-729a55376d48 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:42.562442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:42.576206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0702c76-2f0b-4a53-a760-f99a4f4c4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:42.576878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702c76-2f0b-4a53-a760-f99a4f4c4251 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:42.577145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702c76-2f0b-4a53-a760-f99a4f4c4251 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:42.577412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0702c76-2f0b-4a53-a760-f99a4f4c4251 None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:42.578524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0702c76-2f0b-4a53-a760-f99a4f4c4251 None admin] RBAC: Authorizing `identity:get_project(project_id=c38676a1a63a4a3f99e91eee75f354ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:42.579990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0702c76-2f0b-4a53-a760-f99a4f4c4251 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:42.581607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 552/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:14:42 2022] GET /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:42.588432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:42.684141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dad1c-ebb2-4a30-a0ae-9eeb67061044 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:42.718438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5542b-59b5-4ece-b935-e8ee9bc503c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:42.719024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5542b-59b5-4ece-b935-e8ee9bc503c6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:42.719296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5542b-59b5-4ece-b935-e8ee9bc503c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:42.719592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5542b-59b5-4ece-b935-e8ee9bc503c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:42.720354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5542b-59b5-4ece-b935-e8ee9bc503c6 None admin] RBAC: Adding query filter params (role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=c38676a1a63a4a3f99e91eee75f354ea, user.id=d9d82b92b07e4aefa5f3468a47235fc5) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:42.720606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5542b-59b5-4ece-b935-e8ee9bc503c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:42.722013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5542b-59b5-4ece-b935-e8ee9bc503c6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:42.727351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 565/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:42 2022] GET /identity/v3/role_assignments?user.id=d9d82b92b07e4aefa5f3468a47235fc5&scope.project.id=c38676a1a63a4a3f99e91eee75f354ea&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:44.908042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d306295-bab7-4a5f-8f2a-59309a5cea41 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:44.908609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d306295-bab7-4a5f-8f2a-59309a5cea41 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:44.908609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d306295-bab7-4a5f-8f2a-59309a5cea41 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:44.909928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 553/1118] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:44.915443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa74099-87b0-49ba-b917-040f03bc1569 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:44.915922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa74099-87b0-49ba-b917-040f03bc1569 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:44.916020 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa74099-87b0-49ba-b917-040f03bc1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:44.934861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5fa74099-87b0-49ba-b917-040f03bc1569 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:44.936092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5fa74099-87b0-49ba-b917-040f03bc1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:44.991689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:45.003664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 566/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:45.277423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d306295-bab7-4a5f-8f2a-59309a5cea41 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:45.383819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d306295-bab7-4a5f-8f2a-59309a5cea41 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:45.420008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:45.420645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:45.420926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:45.421198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] PATH_INFO: `/v3/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:45.422604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] RBAC: Authorizing `identity:get_role(role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:45.424035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:45.425387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 554/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:45 2022] GET /identity/v3/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:14:45.431933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa74099-87b0-49ba-b917-040f03bc1569 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:45.532461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa74099-87b0-49ba-b917-040f03bc1569 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:45.565766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:45.566385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:45.566659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:45.566926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] PATH_INFO: `/v3/users/d9d82b92b07e4aefa5f3468a47235fc5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:45.568064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d82b92b07e4aefa5f3468a47235fc5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:45.569478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:45.571038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 567/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:45 2022] GET /identity/v3/users/d9d82b92b07e4aefa5f3468a47235fc5 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:45.577525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:45.637111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:45.680642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c699a-af41-45d9-9b68-1c60435a4a22 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:45.715227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3ca34-9d4c-4783-b776-faceb48c088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:45.715893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ca34-9d4c-4783-b776-faceb48c088e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:45.716169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ca34-9d4c-4783-b776-faceb48c088e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:45.716441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ca34-9d4c-4783-b776-faceb48c088e None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:45.717559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3ca34-9d4c-4783-b776-faceb48c088e None admin] RBAC: Authorizing `identity:get_project(project_id=c38676a1a63a4a3f99e91eee75f354ea)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:45.719002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3ca34-9d4c-4783-b776-faceb48c088e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:45.720683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 555/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:14:45 2022] GET /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:45.726707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:45.786762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:45.830353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cbee6-66d0-4726-8dff-aa33bfd0b131 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:45.864518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604b889-d18c-43e5-8831-da0224cb4ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:45.865170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604b889-d18c-43e5-8831-da0224cb4ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:45.865449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604b889-d18c-43e5-8831-da0224cb4ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:45.865726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604b889-d18c-43e5-8831-da0224cb4ab5 None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea/users/d9d82b92b07e4aefa5f3468a47235fc5/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:45.867928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604b889-d18c-43e5-8831-da0224cb4ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c38676a1a63a4a3f99e91eee75f354ea, user_id=d9d82b92b07e4aefa5f3468a47235fc5, role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:45.869979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604b889-d18c-43e5-8831-da0224cb4ab5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:45.955002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 568/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:14:45 2022] PUT /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea/users/d9d82b92b07e4aefa5f3468a47235fc5/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:14:48.109527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c0aa-7e37-4605-bc7f-cdded0eac180 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:48.110103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c0aa-7e37-4605-bc7f-cdded0eac180 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:48.110103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c0aa-7e37-4605-bc7f-cdded0eac180 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:48.111417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 556/1124] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:48.116650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d54ba-6ffb-4680-8ec3-27a2657f4814 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:48.117101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d54ba-6ffb-4680-8ec3-27a2657f4814 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:48.117191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d54ba-6ffb-4680-8ec3-27a2657f4814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:48.137227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-890d54ba-6ffb-4680-8ec3-27a2657f4814 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:48.138541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-890d54ba-6ffb-4680-8ec3-27a2657f4814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:48.206174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 569/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:48.479113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c0aa-7e37-4605-bc7f-cdded0eac180 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:48.582472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c0aa-7e37-4605-bc7f-cdded0eac180 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:48.606883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:48.617694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:48.618328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:48.618713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:48.618992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] PATH_INFO: `/v3/roles/eb504fd6725b4be1a40619753eab9fc2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:48.620429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] RBAC: Authorizing `identity:get_role(role_id=eb504fd6725b4be1a40619753eab9fc2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:48.621844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:48.623173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 557/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:48 2022] GET /identity/v3/roles/eb504fd6725b4be1a40619753eab9fc2 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:48.629078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d54ba-6ffb-4680-8ec3-27a2657f4814 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:48.678173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:48.727071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d54ba-6ffb-4680-8ec3-27a2657f4814 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:48.763141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:48.763713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:48.763992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:48.764263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] PATH_INFO: `/v3/users/d9d82b92b07e4aefa5f3468a47235fc5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:48.765402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d82b92b07e4aefa5f3468a47235fc5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:48.766825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:48.768478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 570/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:48 2022] GET /identity/v3/users/d9d82b92b07e4aefa5f3468a47235fc5 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:48.774362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:48.880342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f107c9-ae4e-4440-8448-2d2140ddd543 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:48.915982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:48.916599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:48.916873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:48.917140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:48.978600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:48.988267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:48.989930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:49.100143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 558/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:14:49.106471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:49.211906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a37440-713a-486d-b160-aa5aee758d33 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:49.230970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:49.249559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371f5e5-94fb-4d5d-8c11-17ec8d4daff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:49.250195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f5e5-94fb-4d5d-8c11-17ec8d4daff5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:49.250474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f5e5-94fb-4d5d-8c11-17ec8d4daff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:49.250748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371f5e5-94fb-4d5d-8c11-17ec8d4daff5 None admin] PATH_INFO: `/v3/projects/c38676a1a63a4a3f99e91eee75f354ea` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:49.251954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f5e5-94fb-4d5d-8c11-17ec8d4daff5 None admin] RBAC: Authorizing `identity:get_project(project_id=c38676a1a63a4a3f99e91eee75f354ea)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:49.253393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371f5e5-94fb-4d5d-8c11-17ec8d4daff5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:49.255051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 571/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:14:49 2022] GET /identity/v3/projects/c38676a1a63a4a3f99e91eee75f354ea => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:49.263141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:49.363786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:49.373647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c7ca-ccdf-418c-8d4f-19acd9621a7b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:49.409843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d424a-c9e6-48db-838d-652fc30fcc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:49.410457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d424a-c9e6-48db-838d-652fc30fcc03 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:49.410734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d424a-c9e6-48db-838d-652fc30fcc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:49.411010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d424a-c9e6-48db-838d-652fc30fcc03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:49.411768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d424a-c9e6-48db-838d-652fc30fcc03 None admin] RBAC: Adding query filter params (role.id=eb504fd6725b4be1a40619753eab9fc2, scope.project.id=c38676a1a63a4a3f99e91eee75f354ea, user.id=d9d82b92b07e4aefa5f3468a47235fc5) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:49.412073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d424a-c9e6-48db-838d-652fc30fcc03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:49.413499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d424a-c9e6-48db-838d-652fc30fcc03 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:49.419573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 559/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:49 2022] GET /identity/v3/role_assignments?user.id=d9d82b92b07e4aefa5f3468a47235fc5&scope.project.id=c38676a1a63a4a3f99e91eee75f354ea&role.id=eb504fd6725b4be1a40619753eab9fc2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:51.661599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770980c6-0022-4093-9966-9deeb4363b02 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:51.662165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770980c6-0022-4093-9966-9deeb4363b02 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:51.662165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770980c6-0022-4093-9966-9deeb4363b02 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:51.663511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 572/1131] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:51.669699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809da9-3869-4c4b-9a04-e22e024dff69 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:51.670193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809da9-3869-4c4b-9a04-e22e024dff69 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:51.670288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809da9-3869-4c4b-9a04-e22e024dff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:51.690053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-15809da9-3869-4c4b-9a04-e22e024dff69 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:51.691245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15809da9-3869-4c4b-9a04-e22e024dff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:51.758141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 560/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:52.028890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770980c6-0022-4093-9966-9deeb4363b02 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:52.133788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770980c6-0022-4093-9966-9deeb4363b02 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:52.174903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7f753-aefe-4d11-8c84-0d1c980cf030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:52.175556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f753-aefe-4d11-8c84-0d1c980cf030 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:52.175834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f753-aefe-4d11-8c84-0d1c980cf030 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:52.176102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f753-aefe-4d11-8c84-0d1c980cf030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:52.177221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7f753-aefe-4d11-8c84-0d1c980cf030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:52.178646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7f753-aefe-4d11-8c84-0d1c980cf030 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:52.180240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 573/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:52.186848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15809da9-3869-4c4b-9a04-e22e024dff69 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:52.270784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:52.285536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15809da9-3869-4c4b-9a04-e22e024dff69 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:52.319579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530aee3-dfc8-49b1-8f3a-2d22700c829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:52.320182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530aee3-dfc8-49b1-8f3a-2d22700c829e None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:52.320460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530aee3-dfc8-49b1-8f3a-2d22700c829e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:52.320730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530aee3-dfc8-49b1-8f3a-2d22700c829e None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:52.321381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530aee3-dfc8-49b1-8f3a-2d22700c829e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:52.322866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530aee3-dfc8-49b1-8f3a-2d22700c829e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:52.414777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 561/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:14:52 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:54.646983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751665e9-0763-4e9b-bbac-65547a0cd9a6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:54.647584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751665e9-0763-4e9b-bbac-65547a0cd9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:54.647584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751665e9-0763-4e9b-bbac-65547a0cd9a6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:54.648903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 574/1135] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:54.655107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985ae3-02f9-4c5f-91d5-366876bbf174 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:54.655619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985ae3-02f9-4c5f-91d5-366876bbf174 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:54.655727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985ae3-02f9-4c5f-91d5-366876bbf174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:54.675505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-15985ae3-02f9-4c5f-91d5-366876bbf174 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:54.676702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15985ae3-02f9-4c5f-91d5-366876bbf174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:54.743647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 562/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:55.017170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751665e9-0763-4e9b-bbac-65547a0cd9a6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:55.074242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:55.124155 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751665e9-0763-4e9b-bbac-65547a0cd9a6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:55.161035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bfe4c-7e6b-43fe-9c61-be48a27d8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:55.161660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfe4c-7e6b-43fe-9c61-be48a27d8e60 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:55.161940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfe4c-7e6b-43fe-9c61-be48a27d8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:55.162211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bfe4c-7e6b-43fe-9c61-be48a27d8e60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:55.163372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bfe4c-7e6b-43fe-9c61-be48a27d8e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:55.164911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bfe4c-7e6b-43fe-9c61-be48a27d8e60 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:55.166628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 575/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:55.172500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15985ae3-02f9-4c5f-91d5-366876bbf174 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:55.256831 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:55.292818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15985ae3-02f9-4c5f-91d5-366876bbf174 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:55.329549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9242fd-d26d-4a7b-aa26-a95730eae873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:55.330175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9242fd-d26d-4a7b-aa26-a95730eae873 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:55.330433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9242fd-d26d-4a7b-aa26-a95730eae873 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:55.330708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9242fd-d26d-4a7b-aa26-a95730eae873 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:55.331417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9242fd-d26d-4a7b-aa26-a95730eae873 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:55.332848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9242fd-d26d-4a7b-aa26-a95730eae873 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:55.407797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 563/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:14:55 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:14:57.658363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550304f-76bc-4665-b8c9-b66a27bf454c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:57.658948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550304f-76bc-4665-b8c9-b66a27bf454c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:57.658948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550304f-76bc-4665-b8c9-b66a27bf454c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:57.660315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 576/1139] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:14:57.666839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1ea7-f9c1-47d8-b271-a64447a05584 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:57.667412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1ea7-f9c1-47d8-b271-a64447a05584 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:57.667412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1ea7-f9c1-47d8-b271-a64447a05584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:57.686311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-98fb1ea7-f9c1-47d8-b271-a64447a05584 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:14:57.687566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-98fb1ea7-f9c1-47d8-b271-a64447a05584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:14:57.757809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 564/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:14:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:14:58.036642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550304f-76bc-4665-b8c9-b66a27bf454c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:58.151876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550304f-76bc-4665-b8c9-b66a27bf454c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:58.174433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:58.189270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:58.189900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:58.190177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:58.190448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:58.201940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:14:58.207249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:14:58.208508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:14:58.209605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:14:58.210608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 577/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:14:58.215201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1ea7-f9c1-47d8-b271-a64447a05584 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:58.275288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:58.321935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1ea7-f9c1-47d8-b271-a64447a05584 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:58.359936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:58.360546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:58.360819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:58.361091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:58.361759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:58.362059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:58.363484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:58.374347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 565/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:58.380688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:58.494681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde564a-9ee2-442b-a49a-d33617ba241c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:58.531188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:58.531871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:58.532151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:58.532415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] PATH_INFO: `/v3/users/7b56d3b2d7de476b8fe17ab9c9c23522` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:58.547444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] RBAC: Authorizing `identity:get_user(user_id=7b56d3b2d7de476b8fe17ab9c9c23522)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:58.548891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:58.550558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 578/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:14:58 2022] GET /identity/v3/users/7b56d3b2d7de476b8fe17ab9c9c23522 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:58.556789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:58.664567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b4f98-17eb-4c93-806f-68723ba0758c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:58.682130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:58.700207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:58.700814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:58.701091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:58.701361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:58.771142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:58.772637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:58.877457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 566/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:14:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:14:58.884250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:58.924311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:58.986069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c96bfc-8f8b-43cd-9b9c-688cc0f3b39f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:59.022242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52068753-13bc-4785-937e-a24bfafff8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:59.022880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068753-13bc-4785-937e-a24bfafff8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:59.023160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068753-13bc-4785-937e-a24bfafff8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:59.023464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52068753-13bc-4785-937e-a24bfafff8e6 None admin] PATH_INFO: `/v3/projects/34ae6f1c1997449dac9536f64874b616` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:59.025249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52068753-13bc-4785-937e-a24bfafff8e6 None admin] RBAC: Authorizing `identity:get_project(project_id=34ae6f1c1997449dac9536f64874b616)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:59.026655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52068753-13bc-4785-937e-a24bfafff8e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:59.028356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 579/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:14:58 2022] GET /identity/v3/projects/34ae6f1c1997449dac9536f64874b616 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:14:59.034697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:14:59.053277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:14:59.140839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db105f-31ee-40cb-8706-37b95525e676 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:14:59.175098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd530f2-0e07-4abf-b48d-d51bc90bb0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:14:59.175659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd530f2-0e07-4abf-b48d-d51bc90bb0de None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:14:59.175936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd530f2-0e07-4abf-b48d-d51bc90bb0de None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:14:59.176202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd530f2-0e07-4abf-b48d-d51bc90bb0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:14:59.176919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd530f2-0e07-4abf-b48d-d51bc90bb0de None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=34ae6f1c1997449dac9536f64874b616, user.id=7b56d3b2d7de476b8fe17ab9c9c23522) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:14:59.177223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd530f2-0e07-4abf-b48d-d51bc90bb0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:14:59.178637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd530f2-0e07-4abf-b48d-d51bc90bb0de None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:14:59.184717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 567/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:14:59 2022] GET /identity/v3/role_assignments?user.id=7b56d3b2d7de476b8fe17ab9c9c23522&scope.project.id=34ae6f1c1997449dac9536f64874b616&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:01.388981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2033a-fb5c-4ee2-9965-c517976e733b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:01.389579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2033a-fb5c-4ee2-9965-c517976e733b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:01.389579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2033a-fb5c-4ee2-9965-c517976e733b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:01.390855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 580/1147] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:01.396669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7033-ad75-4edb-9b3a-7d45dda136a2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:01.397159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7033-ad75-4edb-9b3a-7d45dda136a2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:01.397528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c7033-ad75-4edb-9b3a-7d45dda136a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:01.417648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5b9c7033-ad75-4edb-9b3a-7d45dda136a2 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:01.418831 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5b9c7033-ad75-4edb-9b3a-7d45dda136a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:01.487945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 568/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:01.773438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2033a-fb5c-4ee2-9965-c517976e733b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:01.878690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2033a-fb5c-4ee2-9965-c517976e733b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:01.887109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:01.914190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:01.914886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:01.915165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:01.915576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:01.925534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:15:01.930556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:15:01.931719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:15:01.932871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 581/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:15:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:15:01.938289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c7033-ad75-4edb-9b3a-7d45dda136a2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:01.951728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:02.041578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c7033-ad75-4edb-9b3a-7d45dda136a2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:02.075808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:02.076421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:02.076694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:02.076963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:02.077621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:02.077919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:02.079284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:02.088797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 569/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:15:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:02.094902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:02.198041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c7104-cfba-404d-8ded-ab7e62f9a70c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:02.231582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:02.232198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:02.232477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:02.232759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] PATH_INFO: `/v3/users/7b56d3b2d7de476b8fe17ab9c9c23522` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:02.233882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] RBAC: Authorizing `identity:get_user(user_id=7b56d3b2d7de476b8fe17ab9c9c23522)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:02.235310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:02.236995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 582/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:15:02 2022] GET /identity/v3/users/7b56d3b2d7de476b8fe17ab9c9c23522 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:02.243660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:02.315980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:02.356795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79588f0d-3175-4412-86f7-ec06477a1056 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:02.405207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1ac02-28f9-420e-b12b-0b547f2f3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:02.406019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ac02-28f9-420e-b12b-0b547f2f3e90 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:02.406178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ac02-28f9-420e-b12b-0b547f2f3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:02.406354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ac02-28f9-420e-b12b-0b547f2f3e90 None admin] PATH_INFO: `/v3/projects/34ae6f1c1997449dac9536f64874b616` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:02.407577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1ac02-28f9-420e-b12b-0b547f2f3e90 None admin] RBAC: Authorizing `identity:get_project(project_id=34ae6f1c1997449dac9536f64874b616)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:02.409020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1ac02-28f9-420e-b12b-0b547f2f3e90 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:02.410686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 570/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:15:02 2022] GET /identity/v3/projects/34ae6f1c1997449dac9536f64874b616 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:02.420915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:02.456184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:02.523952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0eb3-78e2-4c62-bd11-53d013773807 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:02.558789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ed5e2-02e6-4e43-a378-bdf8eb01ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:02.559478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed5e2-02e6-4e43-a378-bdf8eb01ccc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:02.559863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed5e2-02e6-4e43-a378-bdf8eb01ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:02.560067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed5e2-02e6-4e43-a378-bdf8eb01ccc1 None admin] PATH_INFO: `/v3/projects/34ae6f1c1997449dac9536f64874b616/users/7b56d3b2d7de476b8fe17ab9c9c23522/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:02.561993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ed5e2-02e6-4e43-a378-bdf8eb01ccc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=34ae6f1c1997449dac9536f64874b616, user_id=7b56d3b2d7de476b8fe17ab9c9c23522, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:02.563446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ed5e2-02e6-4e43-a378-bdf8eb01ccc1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:02.671732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 583/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:15:02 2022] PUT /identity/v3/projects/34ae6f1c1997449dac9536f64874b616/users/7b56d3b2d7de476b8fe17ab9c9c23522/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:15:04.898280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c9e8-1108-4a89-a08c-5fa83cd3353b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:04.898828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c9e8-1108-4a89-a08c-5fa83cd3353b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:04.898916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c9e8-1108-4a89-a08c-5fa83cd3353b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:04.900906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 571/1154] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:04.907620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02cd78-04de-4376-b7a9-58b12c3e5734 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:04.908131 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02cd78-04de-4376-b7a9-58b12c3e5734 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:04.908221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02cd78-04de-4376-b7a9-58b12c3e5734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:04.928155 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6f02cd78-04de-4376-b7a9-58b12c3e5734 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:04.929360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6f02cd78-04de-4376-b7a9-58b12c3e5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:05.005902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 584/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:05.294627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c9e8-1108-4a89-a08c-5fa83cd3353b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:05.443703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c9e8-1108-4a89-a08c-5fa83cd3353b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:05.483663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:05.484310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:05.484585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:05.484855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:05.494690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:05.498402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:15:05.503797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:15:05.511389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:15:05.512716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 572/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:15:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:15:05.513571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02cd78-04de-4376-b7a9-58b12c3e5734 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:05.551807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:05.642431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02cd78-04de-4376-b7a9-58b12c3e5734 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:05.679045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:05.679679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:05.679957 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:05.680251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:05.681798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:05.682099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:05.683497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:05.692452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 585/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:15:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:05.699010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:05.808811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a813c7-eec6-4d30-bdf7-bfb0d4a150f5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:05.848447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:05.849100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:05.849381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:05.849662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] PATH_INFO: `/v3/users/7b56d3b2d7de476b8fe17ab9c9c23522` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:05.850853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] RBAC: Authorizing `identity:get_user(user_id=7b56d3b2d7de476b8fe17ab9c9c23522)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:05.852931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:05.854571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 573/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:15:05 2022] GET /identity/v3/users/7b56d3b2d7de476b8fe17ab9c9c23522 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:05.860896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:05.951083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:05.966806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd79c89-4f64-46d5-88f3-5ee74f8f81d4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:06.000051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:06.000661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:06.001165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:06.001680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:06.082058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:06.083579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:06.173958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:06.190347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 586/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:15:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:15:06.197718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:06.267119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:06.303476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0ec64-416b-4ab3-9d52-6f23e7e02a36 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:06.348593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cddf3-990c-4cfb-8c46-1fc8c4c68f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:06.349165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cddf3-990c-4cfb-8c46-1fc8c4c68f13 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:06.349450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cddf3-990c-4cfb-8c46-1fc8c4c68f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:06.349728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cddf3-990c-4cfb-8c46-1fc8c4c68f13 None admin] PATH_INFO: `/v3/projects/34ae6f1c1997449dac9536f64874b616` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:06.351004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cddf3-990c-4cfb-8c46-1fc8c4c68f13 None admin] RBAC: Authorizing `identity:get_project(project_id=34ae6f1c1997449dac9536f64874b616)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:06.353181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cddf3-990c-4cfb-8c46-1fc8c4c68f13 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:06.355081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 574/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:15:06 2022] GET /identity/v3/projects/34ae6f1c1997449dac9536f64874b616 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:15:06.361942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:06.474713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719b57-acf1-4209-a8ec-c1c82b0e7382 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:06.513396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77d178-96fc-4e95-94e0-bf57cee89fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:06.513998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d178-96fc-4e95-94e0-bf57cee89fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:06.514366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d178-96fc-4e95-94e0-bf57cee89fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:06.514643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d178-96fc-4e95-94e0-bf57cee89fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:06.515414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77d178-96fc-4e95-94e0-bf57cee89fb1 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=34ae6f1c1997449dac9536f64874b616, user.id=7b56d3b2d7de476b8fe17ab9c9c23522) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:06.515730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77d178-96fc-4e95-94e0-bf57cee89fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:06.517189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77d178-96fc-4e95-94e0-bf57cee89fb1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:06.523905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 587/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:15:06 2022] GET /identity/v3/role_assignments?user.id=7b56d3b2d7de476b8fe17ab9c9c23522&scope.project.id=34ae6f1c1997449dac9536f64874b616&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:15:08.795595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887cc6d-4ab2-409f-b487-545fda116024 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:08.796172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887cc6d-4ab2-409f-b487-545fda116024 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:08.796172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887cc6d-4ab2-409f-b487-545fda116024 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:08.797499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 575/1162] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:08.803481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282154d-352c-442e-8536-e53fffdffa86 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:08.803989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282154d-352c-442e-8536-e53fffdffa86 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:08.804107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282154d-352c-442e-8536-e53fffdffa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:08.823567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a282154d-352c-442e-8536-e53fffdffa86 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:08.824785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a282154d-352c-442e-8536-e53fffdffa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:08.875140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:08.895532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 588/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:09.168949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887cc6d-4ab2-409f-b487-545fda116024 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:09.281722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887cc6d-4ab2-409f-b487-545fda116024 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:09.317047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:09.317656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:09.317933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:09.318204 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:09.322197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:09.392964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:09.394481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:09.504914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 576/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:15:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:15:09.512203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282154d-352c-442e-8536-e53fffdffa86 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:09.614591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282154d-352c-442e-8536-e53fffdffa86 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:09.649871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d99a3-6bec-4c6c-9c13-93a9775b05fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:09.650498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d99a3-6bec-4c6c-9c13-93a9775b05fa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:09.650768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d99a3-6bec-4c6c-9c13-93a9775b05fa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:09.651034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d99a3-6bec-4c6c-9c13-93a9775b05fa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:09.657859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d99a3-6bec-4c6c-9c13-93a9775b05fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:09.659304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d99a3-6bec-4c6c-9c13-93a9775b05fa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-115d99a3-6bec-4c6c-9c13-93a9775b05fa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:15:09.671752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:15:09.673090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:15:09.673989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 589/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:15:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:15:09.679203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:09.718246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:09.789315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f937602-4185-4313-9aef-7bbad95d156f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:09.826029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b833f13-2f04-4e38-8922-eaa768e7ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:09.826697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833f13-2f04-4e38-8922-eaa768e7ff90 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:09.826908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833f13-2f04-4e38-8922-eaa768e7ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:09.827180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b833f13-2f04-4e38-8922-eaa768e7ff90 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:09.827860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b833f13-2f04-4e38-8922-eaa768e7ff90 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:09.828163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b833f13-2f04-4e38-8922-eaa768e7ff90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:09.829549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b833f13-2f04-4e38-8922-eaa768e7ff90 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:09.838074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 577/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Sep 26 12:15:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:12.144595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1a1db-3d54-4860-bed0-55d2d58422f5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:12.145116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1a1db-3d54-4860-bed0-55d2d58422f5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:12.145116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1a1db-3d54-4860-bed0-55d2d58422f5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:12.146468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 590/1167] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:12.151958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96705d-7072-4369-a736-e7aa9cb08a28 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:12.152391 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96705d-7072-4369-a736-e7aa9cb08a28 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:12.152520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96705d-7072-4369-a736-e7aa9cb08a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:12.170931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3a96705d-7072-4369-a736-e7aa9cb08a28 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:12.172205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3a96705d-7072-4369-a736-e7aa9cb08a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:12.241154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 578/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:12.516174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1a1db-3d54-4860-bed0-55d2d58422f5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:12.562767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:12.653023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1a1db-3d54-4860-bed0-55d2d58422f5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:12.691446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e3bd0-53d9-4271-9a74-9741a67f5731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:12.692049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3bd0-53d9-4271-9a74-9741a67f5731 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:12.692325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3bd0-53d9-4271-9a74-9741a67f5731 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:12.692594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e3bd0-53d9-4271-9a74-9741a67f5731 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:12.693269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e3bd0-53d9-4271-9a74-9741a67f5731 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:12.694627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e3bd0-53d9-4271-9a74-9741a67f5731 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:12.827054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 591/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Mon Sep 26 12:15:12 2022] POST /identity/v3/domains => generated 267 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:15:15.047111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7cba6-ad6c-4540-ae6a-fab6b1923ec0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:15.047744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7cba6-ad6c-4540-ae6a-fab6b1923ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:15.047744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7cba6-ad6c-4540-ae6a-fab6b1923ec0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:15.049021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 579/1170] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:15.054882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483fd55-f3ba-4953-b8bb-e390aad52012 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:15.055513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483fd55-f3ba-4953-b8bb-e390aad52012 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:15.055513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483fd55-f3ba-4953-b8bb-e390aad52012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:15.074256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1483fd55-f3ba-4953-b8bb-e390aad52012 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:15.075527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1483fd55-f3ba-4953-b8bb-e390aad52012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:15.143447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 592/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 12:15:15.428290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7cba6-ad6c-4540-ae6a-fab6b1923ec0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:15.459034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:15.532789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7cba6-ad6c-4540-ae6a-fab6b1923ec0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:15.576452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd41086-03d4-430b-a86d-dc981fcddc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:15.577097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41086-03d4-430b-a86d-dc981fcddc82 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:15.577376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41086-03d4-430b-a86d-dc981fcddc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:15.577647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41086-03d4-430b-a86d-dc981fcddc82 None admin] PATH_INFO: `/v3/domains/056659a947e848018baed7db70b91407` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:15.589718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd41086-03d4-430b-a86d-dc981fcddc82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=056659a947e848018baed7db70b91407)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:15.591170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd41086-03d4-430b-a86d-dc981fcddc82 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:15.592843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 580/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Sep 26 12:15:15 2022] GET /identity/v3/domains/056659a947e848018baed7db70b91407 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:15.598667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483fd55-f3ba-4953-b8bb-e390aad52012 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:15.628490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:15.701043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483fd55-f3ba-4953-b8bb-e390aad52012 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:15.734867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8752a-0d2f-4c85-b482-1ea3e2fa4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:15.735495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8752a-0d2f-4c85-b482-1ea3e2fa4c19 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:15.735778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8752a-0d2f-4c85-b482-1ea3e2fa4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:15.736051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8752a-0d2f-4c85-b482-1ea3e2fa4c19 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:15.736700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8752a-0d2f-4c85-b482-1ea3e2fa4c19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:15.738132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8752a-0d2f-4c85-b482-1ea3e2fa4c19 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:15.826198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 593/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:15:15 2022] POST /identity/v3/projects => generated 361 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:15:18.049271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd7dcc-3c26-449c-9ab4-38192d7e0010 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:18.049825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd7dcc-3c26-449c-9ab4-38192d7e0010 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:18.049825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd7dcc-3c26-449c-9ab4-38192d7e0010 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:18.051146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 581/1174] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:18.056672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848e8f3-f108-45a0-b4c5-a08fde40c3c7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:18.057105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848e8f3-f108-45a0-b4c5-a08fde40c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:18.057217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848e8f3-f108-45a0-b4c5-a08fde40c3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:18.075975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e848e8f3-f108-45a0-b4c5-a08fde40c3c7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:18.077171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e848e8f3-f108-45a0-b4c5-a08fde40c3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:18.144389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 594/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:18.425282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd7dcc-3c26-449c-9ab4-38192d7e0010 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:18.525822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:18.537273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd7dcc-3c26-449c-9ab4-38192d7e0010 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:18.579709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8fe22-3e07-4fa2-b256-606f1c968e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:18.580361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fe22-3e07-4fa2-b256-606f1c968e4e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:18.580643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fe22-3e07-4fa2-b256-606f1c968e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:18.580918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8fe22-3e07-4fa2-b256-606f1c968e4e None admin] PATH_INFO: `/v3/domains/056659a947e848018baed7db70b91407` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:18.582068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8fe22-3e07-4fa2-b256-606f1c968e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=056659a947e848018baed7db70b91407)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:18.583549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8fe22-3e07-4fa2-b256-606f1c968e4e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:18.585134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 582/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Sep 26 12:15:18 2022] GET /identity/v3/domains/056659a947e848018baed7db70b91407 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:18.591932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848e8f3-f108-45a0-b4c5-a08fde40c3c7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:18.608030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:18.700613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848e8f3-f108-45a0-b4c5-a08fde40c3c7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:18.737653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e2b57-aeb6-48bf-99bc-bcc6b4987d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:18.738256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e2b57-aeb6-48bf-99bc-bcc6b4987d71 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:18.738533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e2b57-aeb6-48bf-99bc-bcc6b4987d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:18.738803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e2b57-aeb6-48bf-99bc-bcc6b4987d71 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:18.739511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e2b57-aeb6-48bf-99bc-bcc6b4987d71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:18.740942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e2b57-aeb6-48bf-99bc-bcc6b4987d71 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:18.876921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 595/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:15:18 2022] POST /identity/v3/users => generated 311 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:15:21.094547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63139359-befe-4757-93fa-7f30eb1661ed None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:21.095073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63139359-befe-4757-93fa-7f30eb1661ed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:21.095073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63139359-befe-4757-93fa-7f30eb1661ed None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:21.096459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 583/1178] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:21.101748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f817e7-d8c7-41c7-8750-2c35989a6a66 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:21.102438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f817e7-d8c7-41c7-8750-2c35989a6a66 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:21.102438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f817e7-d8c7-41c7-8750-2c35989a6a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:21.120569 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d3f817e7-d8c7-41c7-8750-2c35989a6a66 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:21.121754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d3f817e7-d8c7-41c7-8750-2c35989a6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:21.184041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:21.189801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 596/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:21.462648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63139359-befe-4757-93fa-7f30eb1661ed None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:21.567723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63139359-befe-4757-93fa-7f30eb1661ed None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:21.602821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:21.603538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:21.603913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:21.604164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:21.614224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:15:21.619035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:15:21.620094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:15:21.621035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 584/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:15:21.626300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f817e7-d8c7-41c7-8750-2c35989a6a66 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:21.763609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f817e7-d8c7-41c7-8750-2c35989a6a66 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:21.798908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:21.799598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:21.799853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:21.800121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:21.800789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:21.801086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:21.802441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:21.811888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 597/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:21.821192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:21.841549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:21.928665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5ec3-e360-4d38-a2d8-be602633bf05 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:21.969271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:21.969906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:21.970182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:21.970451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] PATH_INFO: `/v3/users/b3496dbb0c634c10aef0cfc64b6a95d6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:21.985210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] RBAC: Authorizing `identity:get_user(user_id=b3496dbb0c634c10aef0cfc64b6a95d6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:21.986687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:21.988438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 585/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:15:21 2022] GET /identity/v3/users/b3496dbb0c634c10aef0cfc64b6a95d6 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:21.995468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:22.060675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:22.103894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63ea82-cbbb-409a-9a00-bf24a56bd6db None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:22.137794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:22.138391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:22.138663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:22.138930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:22.204651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:22.206080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:22.264926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:22.306549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 598/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:15:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:15:22.312641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:22.391969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:22.416669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5c68-d4b0-41c3-b29b-e537dd8b47b3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:22.453572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa04d87-ddb8-40b6-8c9f-802043019abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:22.454202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04d87-ddb8-40b6-8c9f-802043019abd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:22.454473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04d87-ddb8-40b6-8c9f-802043019abd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:22.454742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04d87-ddb8-40b6-8c9f-802043019abd None admin] PATH_INFO: `/v3/projects/d1f4251cde7c49fb9b2cda141738280e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:22.455888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa04d87-ddb8-40b6-8c9f-802043019abd None admin] RBAC: Authorizing `identity:get_project(project_id=d1f4251cde7c49fb9b2cda141738280e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:22.457307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa04d87-ddb8-40b6-8c9f-802043019abd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:22.458922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 586/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:15:22 2022] GET /identity/v3/projects/d1f4251cde7c49fb9b2cda141738280e => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:22.465178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:22.570214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bf19f-30f9-4606-9467-7635eb7ea2c7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:22.606681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422b45c-d88c-43ac-bc9e-dab4d306bc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:22.607280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422b45c-d88c-43ac-bc9e-dab4d306bc9f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:22.607591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422b45c-d88c-43ac-bc9e-dab4d306bc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:22.607862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422b45c-d88c-43ac-bc9e-dab4d306bc9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:22.608584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422b45c-d88c-43ac-bc9e-dab4d306bc9f None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=d1f4251cde7c49fb9b2cda141738280e, user.id=b3496dbb0c634c10aef0cfc64b6a95d6) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:22.608891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422b45c-d88c-43ac-bc9e-dab4d306bc9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:22.610304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422b45c-d88c-43ac-bc9e-dab4d306bc9f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:22.615824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 599/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:15:22 2022] GET /identity/v3/role_assignments?user.id=b3496dbb0c634c10aef0cfc64b6a95d6&scope.project.id=d1f4251cde7c49fb9b2cda141738280e&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:24.806330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602d8b-fa97-4ddd-a840-037f764fe43d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:24.806892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602d8b-fa97-4ddd-a840-037f764fe43d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:24.806892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab602d8b-fa97-4ddd-a840-037f764fe43d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:24.808288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 587/1186] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:15:24.814309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29755-8e0a-4f60-84de-42793667a186 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:24.815053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29755-8e0a-4f60-84de-42793667a186 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:24.815053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd29755-8e0a-4f60-84de-42793667a186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:24.834073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5bd29755-8e0a-4f60-84de-42793667a186 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:24.835274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5bd29755-8e0a-4f60-84de-42793667a186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:24.854801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:24.903917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 600/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:25.172444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab602d8b-fa97-4ddd-a840-037f764fe43d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:25.274566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab602d8b-fa97-4ddd-a840-037f764fe43d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:25.307618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:25.308258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:25.308536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:25.308806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:25.319877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:15:25.325508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:15:25.326551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:15:25.327443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 588/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:15:25.332992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29755-8e0a-4f60-84de-42793667a186 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:25.438101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd29755-8e0a-4f60-84de-42793667a186 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:25.475016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:25.475654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:25.475932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:25.476206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:25.477567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:25.477867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:25.479234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:25.488110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 601/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:25.494809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:25.499154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:25.596279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101f855-36b9-4150-ae06-b4abb62b5dd8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:25.632288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:25.633481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:25.633756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:25.634021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] PATH_INFO: `/v3/users/b3496dbb0c634c10aef0cfc64b6a95d6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:25.635159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] RBAC: Authorizing `identity:get_user(user_id=b3496dbb0c634c10aef0cfc64b6a95d6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:25.636621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:25.638462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 589/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:15:25 2022] GET /identity/v3/users/b3496dbb0c634c10aef0cfc64b6a95d6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:15:25.644596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:25.663264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:25.747109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d821567-7c8a-4822-a430-f44d82571db0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:25.780895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955dfee-6aa0-49ee-9820-22c0ecd66ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:25.781527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955dfee-6aa0-49ee-9820-22c0ecd66ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:25.781799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955dfee-6aa0-49ee-9820-22c0ecd66ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:25.782066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955dfee-6aa0-49ee-9820-22c0ecd66ee3 None admin] PATH_INFO: `/v3/projects/d1f4251cde7c49fb9b2cda141738280e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:25.783192 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955dfee-6aa0-49ee-9820-22c0ecd66ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=d1f4251cde7c49fb9b2cda141738280e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:25.784644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955dfee-6aa0-49ee-9820-22c0ecd66ee3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:25.786288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 602/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:15:25 2022] GET /identity/v3/projects/d1f4251cde7c49fb9b2cda141738280e => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:25.797286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:25.871816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:25.903076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001aae7-56c4-4dc4-b4ca-df0db03b900b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:25.942797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed9a48-75a0-4d1c-a040-8edd1ae50fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:25.943500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed9a48-75a0-4d1c-a040-8edd1ae50fc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:25.943781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed9a48-75a0-4d1c-a040-8edd1ae50fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:25.944052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed9a48-75a0-4d1c-a040-8edd1ae50fc2 None admin] PATH_INFO: `/v3/projects/d1f4251cde7c49fb9b2cda141738280e/users/b3496dbb0c634c10aef0cfc64b6a95d6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:25.946430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed9a48-75a0-4d1c-a040-8edd1ae50fc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1f4251cde7c49fb9b2cda141738280e, user_id=b3496dbb0c634c10aef0cfc64b6a95d6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:25.948262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed9a48-75a0-4d1c-a040-8edd1ae50fc2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:26.059741 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 590/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:15:25 2022] PUT /identity/v3/projects/d1f4251cde7c49fb9b2cda141738280e/users/b3496dbb0c634c10aef0cfc64b6a95d6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:15:28.215173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343fc7b-1852-4c92-a45a-15b2ce15c2e3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:28.215754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343fc7b-1852-4c92-a45a-15b2ce15c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:28.215861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343fc7b-1852-4c92-a45a-15b2ce15c2e3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:28.217143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 603/1193] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:15:28.222574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bc06-7829-4f2c-a68b-7d0fe782c3bd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:28.223003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bc06-7829-4f2c-a68b-7d0fe782c3bd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:28.223135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bc06-7829-4f2c-a68b-7d0fe782c3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:28.241542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0e40bc06-7829-4f2c-a68b-7d0fe782c3bd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:15:28.242748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0e40bc06-7829-4f2c-a68b-7d0fe782c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:15:28.310346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 591/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:15:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:15:28.579586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343fc7b-1852-4c92-a45a-15b2ce15c2e3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:28.663107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:28.680847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343fc7b-1852-4c92-a45a-15b2ce15c2e3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:28.714089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:28.714710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:28.714987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:28.715257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:28.725253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:15:28.730830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:15:28.731933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:15:28.733108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 604/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:15:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:15:28.738046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40bc06-7829-4f2c-a68b-7d0fe782c3bd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:28.800093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:28.840984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40bc06-7829-4f2c-a68b-7d0fe782c3bd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:28.875986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:28.876600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:28.876884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:28.877157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:28.877858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:28.878164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:28.879563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:28.888972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 592/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:28.895118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:28.998030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43056b0-506d-43b4-affa-d5179757f68a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:29.033540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:29.034160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:29.034439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:29.034711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] PATH_INFO: `/v3/users/b3496dbb0c634c10aef0cfc64b6a95d6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:29.035857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] RBAC: Authorizing `identity:get_user(user_id=b3496dbb0c634c10aef0cfc64b6a95d6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:29.037281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:29.038886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 605/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Sep 26 12:15:28 2022] GET /identity/v3/users/b3496dbb0c634c10aef0cfc64b6a95d6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:29.044813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:29.144813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee41f2-00c9-47bf-aaab-8ce9d7c3e012 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:29.167448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:29.177897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:29.179064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:29.179064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:29.179064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:29.246733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:29.248252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:29.348524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 593/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:15:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:15:29.354499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:29.369729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:29.479089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5c5c2-83f1-442b-a678-fbb24a87c47b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:29.523649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e72131-14c7-46d4-a7d4-14205fd5656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:29.524477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e72131-14c7-46d4-a7d4-14205fd5656a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:29.524762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e72131-14c7-46d4-a7d4-14205fd5656a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:29.525547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e72131-14c7-46d4-a7d4-14205fd5656a None admin] PATH_INFO: `/v3/projects/d1f4251cde7c49fb9b2cda141738280e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:29.526273 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e72131-14c7-46d4-a7d4-14205fd5656a None admin] RBAC: Authorizing `identity:get_project(project_id=d1f4251cde7c49fb9b2cda141738280e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:29.527721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e72131-14c7-46d4-a7d4-14205fd5656a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:29.529657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 606/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Sep 26 12:15:29 2022] GET /identity/v3/projects/d1f4251cde7c49fb9b2cda141738280e => generated 361 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:29.537832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:15:29.566010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:29.657101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313ba3a-74d2-4c26-a1de-0beda4ce3258 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:15:29.702098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d47b78-5731-4aef-8cb4-44875cc404e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:15:29.702716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47b78-5731-4aef-8cb4-44875cc404e4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:15:29.702992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47b78-5731-4aef-8cb4-44875cc404e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:15:29.703263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47b78-5731-4aef-8cb4-44875cc404e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:15:29.704014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d47b78-5731-4aef-8cb4-44875cc404e4 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=d1f4251cde7c49fb9b2cda141738280e, user.id=b3496dbb0c634c10aef0cfc64b6a95d6) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:15:29.704397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d47b78-5731-4aef-8cb4-44875cc404e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:15:29.706469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d47b78-5731-4aef-8cb4-44875cc404e4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:15:29.714358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 594/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:15:29 2022] GET /identity/v3/role_assignments?user.id=b3496dbb0c634c10aef0cfc64b6a95d6&scope.project.id=d1f4251cde7c49fb9b2cda141738280e&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:15:39.517532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=60 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:15:39.710096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=56 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:49.823041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669603-67df-43b2-85b8-e8da3fa963a6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:49.823688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669603-67df-43b2-85b8-e8da3fa963a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:49.823688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed669603-67df-43b2-85b8-e8da3fa963a6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:49.824948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 607/1201] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:16:49.830462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439629b-9e68-42ea-9d00-a5f59c604354 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:49.830922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439629b-9e68-42ea-9d00-a5f59c604354 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:49.831017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439629b-9e68-42ea-9d00-a5f59c604354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:49.850179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e439629b-9e68-42ea-9d00-a5f59c604354 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:16:49.851409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e439629b-9e68-42ea-9d00-a5f59c604354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:16:49.921275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 595/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:16:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:16:50.188825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed669603-67df-43b2-85b8-e8da3fa963a6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:50.296188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed669603-67df-43b2-85b8-e8da3fa963a6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:50.332895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:50.333550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:50.333821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:50.334084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:50.343935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:50.345359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:16:50.359659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:50.366414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:16:50.367556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:16:50.367556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:50.367556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:16:50.367556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 608/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:50.367809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439629b-9e68-42ea-9d00-a5f59c604354 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:50.467841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439629b-9e68-42ea-9d00-a5f59c604354 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:50.496966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:50.502837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832f42d-142c-4b39-aca5-af37185eb72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:50.503474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832f42d-142c-4b39-aca5-af37185eb72b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:50.503757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832f42d-142c-4b39-aca5-af37185eb72b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:50.504028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832f42d-142c-4b39-aca5-af37185eb72b None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:50.504671 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832f42d-142c-4b39-aca5-af37185eb72b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:50.505078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832f42d-142c-4b39-aca5-af37185eb72b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:50.506687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832f42d-142c-4b39-aca5-af37185eb72b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:50.518061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 596/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:16:50.524172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:50.578146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:50.625432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049312bf-2657-4ed4-a4ed-5b5ea147e9d6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:50.658044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116b95e-58ac-4848-9af3-b0a1dfa95ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:50.658642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b95e-58ac-4848-9af3-b0a1dfa95ab7 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:50.658922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b95e-58ac-4848-9af3-b0a1dfa95ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:50.659195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116b95e-58ac-4848-9af3-b0a1dfa95ab7 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:50.659870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116b95e-58ac-4848-9af3-b0a1dfa95ab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:50.661795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116b95e-58ac-4848-9af3-b0a1dfa95ab7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:50.811329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 609/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Sep 26 12:16:50 2022] POST /identity/v3/users => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:16:53.054867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7997d-823e-4d8e-8b8d-b2141af68a42 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:53.055465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7997d-823e-4d8e-8b8d-b2141af68a42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:53.055465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7997d-823e-4d8e-8b8d-b2141af68a42 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:53.056792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 597/1206] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:16:53.062090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72619-7f58-41ad-ab65-fc1cde4f53ee None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:53.062518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72619-7f58-41ad-ab65-fc1cde4f53ee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:53.062617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac72619-7f58-41ad-ab65-fc1cde4f53ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:53.081222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2ac72619-7f58-41ad-ab65-fc1cde4f53ee None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:16:53.082397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2ac72619-7f58-41ad-ab65-fc1cde4f53ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:16:53.151606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 610/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:16:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:16:53.418205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7997d-823e-4d8e-8b8d-b2141af68a42 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:53.529418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7997d-823e-4d8e-8b8d-b2141af68a42 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:53.570084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:53.570728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:53.571009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:53.571280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:53.581994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:16:53.587605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:53.594085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:53.595225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 598/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:16:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:53.596183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72619-7f58-41ad-ab65-fc1cde4f53ee None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:53.635617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:53.697101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac72619-7f58-41ad-ab65-fc1cde4f53ee None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:53.733363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:53.733970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:53.734247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:53.734519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:53.735192 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:53.735529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:53.736898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:53.745865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 611/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:16:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:16:53.751752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:53.805410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:53.858935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c2788-9708-47d5-b8c3-0451aba80682 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:53.895574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:53.896216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:53.896521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:53.896793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:53.907488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:53.908962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:16:53.922822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:53.923909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:16:53.924816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:16:53.924816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:53.924816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:53.925185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 599/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:53.930630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:54.030695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:54.033635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089101d-3877-4ac5-9280-8c0ea21f31a8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:54.068515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:54.069253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:54.069379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:54.069649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:54.070292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:54.070593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:54.071982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:54.084392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 612/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:54.090331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:54.192181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8cc7c-c88c-4a20-a126-390394934f0f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:54.193808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:54.226893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:54.227546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:54.227829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:54.228100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:54.234971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:54.236483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:16:54.248067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:54.249275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:54.250450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 600/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:16:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:54.255667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:54.355846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21407-7da4-4006-8532-a46744df2e9d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:54.389951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:54.390545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:54.390886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:54.391153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:54.391924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:54.398638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:54.398638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:54.411166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 613/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Sep 26 12:16:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:54.417031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:54.519855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b9193-e818-4b39-b05c-667dbf47f659 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:54.555328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:54.555967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:54.556251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:54.556525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:54.586910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:54.624534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:54.625988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:54.727646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 601/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:16:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:16:54.733772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:54.759596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:54.857061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f4c3-e2ec-4537-9d87-79de48139f49 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:54.897568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:54.898107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:54.898381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:54.898645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:54.909167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:54.910613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:16:54.925543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:54.928026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:16:54.929167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:16:54.929167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:54.929167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:16:54.929167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 614/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:54.933086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:55.002990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:55.056819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0788cf9-2ef3-4fb6-bf94-39eb25548a1d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:55.092426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:55.093197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:55.093310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:55.093558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:55.094209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:55.094589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:55.096002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:55.108667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 602/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:55.114947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:55.190856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:55.222766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c200e-1062-42b0-a36f-d932daa6e100 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:55.256932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:55.257568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:55.257845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:55.258121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:55.265327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:55.268725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:16:55.279235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:55.280400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:16:55.281719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 615/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:55.286895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:55.394468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bae4dd-01cc-4002-ac21-d613218f4d35 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:55.420308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:55.432638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc9e8-5261-4be1-9906-92080b3e1f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:55.433247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc9e8-5261-4be1-9906-92080b3e1f89 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:55.433529 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc9e8-5261-4be1-9906-92080b3e1f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:55.433801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc9e8-5261-4be1-9906-92080b3e1f89 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:55.434494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dc9e8-5261-4be1-9906-92080b3e1f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:55.434799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dc9e8-5261-4be1-9906-92080b3e1f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:55.436265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dc9e8-5261-4be1-9906-92080b3e1f89 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:55.449001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 603/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:55.455328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:55.558079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbd6d3-2eb2-40f2-a011-e341744dd1a2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:55.587735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:55.593426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cebbec-0262-492a-95d8-31260a392fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:55.594016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebbec-0262-492a-95d8-31260a392fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:55.594289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebbec-0262-492a-95d8-31260a392fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:55.594560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebbec-0262-492a-95d8-31260a392fa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:55.595273 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cebbec-0262-492a-95d8-31260a392fa9 None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=ba94572d0db5429ab9275319ef2ee403) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:55.595604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cebbec-0262-492a-95d8-31260a392fa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:55.597005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cebbec-0262-492a-95d8-31260a392fa9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:55.602974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 616/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:16:55 2022] GET /identity/v3/role_assignments?user.id=ba94572d0db5429ab9275319ef2ee403&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:57.816376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a5bd-8da8-42a4-af23-c96234af08cb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:57.816993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a5bd-8da8-42a4-af23-c96234af08cb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:57.816993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a5bd-8da8-42a4-af23-c96234af08cb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:57.818289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 604/1220] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:16:57.825360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5391f41-db42-45f0-b181-f390a3abe6dc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:57.825953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5391f41-db42-45f0-b181-f390a3abe6dc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:57.825953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5391f41-db42-45f0-b181-f390a3abe6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:57.845671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c5391f41-db42-45f0-b181-f390a3abe6dc None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:16:57.846896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c5391f41-db42-45f0-b181-f390a3abe6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:16:57.922763 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 617/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:16:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:16:58.202122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a5bd-8da8-42a4-af23-c96234af08cb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:58.318188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a5bd-8da8-42a4-af23-c96234af08cb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:58.352773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:58.353329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:58.353601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:58.353878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:58.364597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:16:58.369508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:58.371592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:58.372710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 605/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:16:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:16:58.376772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5391f41-db42-45f0-b181-f390a3abe6dc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:58.483052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5391f41-db42-45f0-b181-f390a3abe6dc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:58.511315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:58.523382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:58.523993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:58.524270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:58.524598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:58.525366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:58.525713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:58.527133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:58.538195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 618/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:16:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:58.544238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:58.595207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:58.656500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701a01-5dbc-4524-b072-d584ff6511a2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:58.693093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:58.761283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:58.761283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:58.761283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:58.761283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:58.761283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:58.761283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:58.761283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:58.762192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:58.763251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:58.764284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 606/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:58.764365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:58.842639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74fadc-144c-4fa5-bcf9-48327008ee08 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:58.888440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:58.889066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:58.889347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:58.889623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:58.890316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:58.890646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:58.892143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:58.906003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 619/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:58.912811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:59.018711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:59.026113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d8c1-154f-4c11-bec0-04b96547e065 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:59.074924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:59.075594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:59.075869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:59.076136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:59.085110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:59.086681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:16:59.099577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:59.114792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:59.116264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 607/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:16:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:59.117071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:59.162690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:59.215907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5496ce-5a92-4bb1-8e05-026ec96e9a40 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:59.250590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:59.251191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:59.251503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:59.251778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:59.252505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:59.252811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:59.254315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:59.274627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 620/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Sep 26 12:16:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:59.280828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:59.391821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c151a12-3e67-4d69-b85a-6887c829bafb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:59.430071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:59.430723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:59.431003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:59.431280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:59.442942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:59.444465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:16:59.466288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:59.468105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:16:59.470115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:16:59.470115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:16:59.470115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:59.470115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 608/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:59.475582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:59.589028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a783bd-a137-429a-aeaf-04715b0101dc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:59.590863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:59.622285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:59.622880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:59.623159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:59.623462 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:59.624100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:59.624402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:59.625754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:59.638012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 621/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:59.643773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:59.654094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:16:59.750936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25f0ad-5a9f-4821-a9e7-17500e29bea1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:59.787006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:59.787740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:59.787979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:59.788255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:59.797516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:59.800777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:16:59.813622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:16:59.814747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:16:59.815909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 609/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:16:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:16:59.820849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:16:59.919765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384ba3e-3057-4d95-94b9-70f1eb946752 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:16:59.953074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cf17b-e662-4c9c-a078-c46fb23716b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:16:59.953670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cf17b-e662-4c9c-a078-c46fb23716b0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:16:59.953946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cf17b-e662-4c9c-a078-c46fb23716b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:16:59.954213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cf17b-e662-4c9c-a078-c46fb23716b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:16:59.954895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cf17b-e662-4c9c-a078-c46fb23716b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:16:59.955236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cf17b-e662-4c9c-a078-c46fb23716b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:16:59.956617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cf17b-e662-4c9c-a078-c46fb23716b0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:16:59.969229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 622/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:16:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:16:59.975957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:00.042998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:00.079512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6ef3f-ea72-44ea-b781-c4824d2dce95 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:00.115515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e14bea-3993-497c-8623-839cd4fa3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:00.125061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e14bea-3993-497c-8623-839cd4fa3dc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:00.125061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e14bea-3993-497c-8623-839cd4fa3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:00.125061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e14bea-3993-497c-8623-839cd4fa3dc7 None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/ba94572d0db5429ab9275319ef2ee403/roles/e5d4d76180364a138e4c8c41652caa4d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:00.132806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e14bea-3993-497c-8623-839cd4fa3dc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=ba94572d0db5429ab9275319ef2ee403, role_id=e5d4d76180364a138e4c8c41652caa4d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:00.134255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e14bea-3993-497c-8623-839cd4fa3dc7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:00.231148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 610/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:16:59 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/ba94572d0db5429ab9275319ef2ee403/roles/e5d4d76180364a138e4c8c41652caa4d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:17:02.413563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6b96-82f4-4e0b-9e73-0f17f8998340 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:02.414092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6b96-82f4-4e0b-9e73-0f17f8998340 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:02.414092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6b96-82f4-4e0b-9e73-0f17f8998340 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:02.417730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 623/1233] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:02.421986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d91cb-8fb0-420c-8dc6-19eadcf1d955 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:02.422431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d91cb-8fb0-420c-8dc6-19eadcf1d955 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:02.422528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d91cb-8fb0-420c-8dc6-19eadcf1d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:02.441527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7a1d91cb-8fb0-420c-8dc6-19eadcf1d955 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:02.442738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a1d91cb-8fb0-420c-8dc6-19eadcf1d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:02.514557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 611/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:02.785297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6b96-82f4-4e0b-9e73-0f17f8998340 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:02.818173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:02.903405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6b96-82f4-4e0b-9e73-0f17f8998340 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:02.942794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:02.943447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:02.943730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:02.944005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:02.955052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:17:02.960814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:02.961988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:02.962896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 624/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Sep 26 12:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:02.968603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d91cb-8fb0-420c-8dc6-19eadcf1d955 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:03.026012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:03.079473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d91cb-8fb0-420c-8dc6-19eadcf1d955 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:03.117660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:03.118268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:03.118540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:03.118806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:03.119499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:03.119799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:03.121159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:03.129626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 612/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Sep 26 12:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:17:03.135877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:03.225078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:03.240737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a0cbf-465e-47dd-906d-3ba925bde561 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:03.275627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:03.276248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:03.276525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:03.276796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:03.286748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:03.288241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:03.302943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:03.310595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:03.311610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:03.311610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:03.311610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:03.311610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 625/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:03.311837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:03.415357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc8d8d-9273-4763-98c2-3b8135d8a68a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:03.425061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:03.474285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:03.474886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:03.475166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:03.475462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:03.476098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:03.476397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:03.477851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:03.502225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 613/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:03.508123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:03.608955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e9c5-7607-4734-b835-e112f10c14a8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:03.642254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:03.642860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:03.643136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:03.643435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:03.646672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:03.651632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:03.653050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:17:03.664932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:03.685311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:03.686475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 626/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:17:03.687096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:03.773844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd821ec-d4a7-4f62-96b6-1845804c4116 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:03.812814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:03.813685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:03.813969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:03.814234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:03.815071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:03.817300 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:03.818795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:03.841217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 614/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Sep 26 12:17:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:03.847169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:03.959248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798048b-8fb0-4e00-a75a-3f208084b5d2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:03.995064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:03.995810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:03.996156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:03.996471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:04.061781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:04.068660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:04.070164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:04.174373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 627/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:17:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:17:04.182458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:04.210374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:04.289147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1d465-0e59-4144-a699-520427bd7088 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:04.327411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:04.328064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:04.328452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:04.328686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:04.340516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:04.341989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:04.358481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:04.359599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:04.360563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:04.360563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:04.360563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:04.360563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 615/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:04.365727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:04.467902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:04.474882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7e6c4-d32d-4ba2-8292-459bd8760fd3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:04.510540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:04.511232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:04.511454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:04.511989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:04.512636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:04.512944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:04.514321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:04.526656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 628/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:04.532643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:04.615191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:04.647138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8058-b4ad-4ba7-80ae-7678092fc091 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:04.687243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:04.687921 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:04.688201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:04.688472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:04.697025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:04.698585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:17:04.711800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:04.713536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:04.715393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:04.717994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 616/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:04.719202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:04.831703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c07a-b071-4773-ac80-f05f8f568ab4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:04.870468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68631e65-7ff0-44cc-bd0d-3917a00a1126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:04.871103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631e65-7ff0-44cc-bd0d-3917a00a1126 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:04.871415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631e65-7ff0-44cc-bd0d-3917a00a1126 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:04.871680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68631e65-7ff0-44cc-bd0d-3917a00a1126 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:04.874781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68631e65-7ff0-44cc-bd0d-3917a00a1126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:04.874781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68631e65-7ff0-44cc-bd0d-3917a00a1126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:04.874781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68631e65-7ff0-44cc-bd0d-3917a00a1126 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:04.888921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 629/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:04.899151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:05.016076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92204f6-f088-46a5-8526-c950af89034e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:05.051749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a577a-f349-4576-b46f-02c1ed0ac8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:05.052361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a577a-f349-4576-b46f-02c1ed0ac8ae None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:05.052637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a577a-f349-4576-b46f-02c1ed0ac8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:05.052905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a577a-f349-4576-b46f-02c1ed0ac8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:05.053624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a577a-f349-4576-b46f-02c1ed0ac8ae None admin] RBAC: Adding query filter params (role.id=e5d4d76180364a138e4c8c41652caa4d, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=ba94572d0db5429ab9275319ef2ee403) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:05.053926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a577a-f349-4576-b46f-02c1ed0ac8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:05.055368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a577a-f349-4576-b46f-02c1ed0ac8ae None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:05.061482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 617/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:17:04 2022] GET /identity/v3/role_assignments?user.id=ba94572d0db5429ab9275319ef2ee403&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=e5d4d76180364a138e4c8c41652caa4d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:07.379976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6966a-aa5c-4b19-a19c-56d2962086ef None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:07.380564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6966a-aa5c-4b19-a19c-56d2962086ef None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:07.380724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6966a-aa5c-4b19-a19c-56d2962086ef None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:07.382089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 630/1247] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:07.388246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56722bf-e349-4f8c-8682-da1c9c20ce18 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:07.388782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56722bf-e349-4f8c-8682-da1c9c20ce18 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:07.388782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56722bf-e349-4f8c-8682-da1c9c20ce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:07.395812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:07.409231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b56722bf-e349-4f8c-8682-da1c9c20ce18 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:07.410593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b56722bf-e349-4f8c-8682-da1c9c20ce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:07.488229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 618/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:07.765624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6966a-aa5c-4b19-a19c-56d2962086ef None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:07.784559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:07.875327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6966a-aa5c-4b19-a19c-56d2962086ef None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:07.912960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:07.913592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:07.913866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:07.914134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:07.924466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:17:07.930171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:07.931417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:07.932314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 631/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:07.937650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56722bf-e349-4f8c-8682-da1c9c20ce18 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:08.052166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56722bf-e349-4f8c-8682-da1c9c20ce18 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:08.085609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:08.090730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:08.091390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:08.091669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:08.091937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:08.092623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:08.092924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:08.094314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:08.103665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 619/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:08.109791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:08.198584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:08.226506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8e66-1ef1-445b-81bc-96e0dccf673e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:08.263929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:08.264563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:08.264838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:08.265107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:08.277085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:08.278590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:08.297101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:08.298845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:08.300590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:08.300590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:08.300590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:08.300590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 632/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:08.305167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:08.429839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097049e-b997-445f-a039-08ab2caa5581 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:08.471019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:08.471744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:08.477223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:08.477223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:08.477223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:08.477223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:08.477223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:08.491079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 620/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:08.497222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:08.610636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c8dae-5e8a-4ffb-ba20-7f326e556f71 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:08.639979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:08.648248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:08.648942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:08.649218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:08.649479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:08.657761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:08.659202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:17:08.672088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:08.673975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:08.675583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 633/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:08.680314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:08.761008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:08.814509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052220-1052-4305-ae0b-858ba262e75d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:08.850807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:08.851452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:08.851727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:08.851994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:08.852729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:08.853029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:08.854468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:08.873896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 621/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Sep 26 12:17:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:17:08.880556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:09.001956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6d6ab-1957-4512-949a-51ed0001a266 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:09.037124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:09.037734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:09.038016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:09.038291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:09.095488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:09.109432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:09.110891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:09.217983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 634/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:17:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 12:17:09.224746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:09.325904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cee6cb-038f-4405-bc3d-468f69c03f64 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:09.339761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:09.361590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:09.367796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:09.367796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:09.367796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:09.373736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:09.375241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:09.393450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:09.394655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:09.396586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:09.396586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:09.396586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:09.396586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 622/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:17:09.401255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:09.516029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:09.528173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17b5d2-394a-4be7-92b0-b6df99ffd452 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:09.565625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:09.566362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:09.566678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:09.566946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:09.567642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:09.567943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:09.569331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:09.581264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 635/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:17:09.588000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:09.708670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35f905-d720-4028-af43-e33b7aa9ccad None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:09.745563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:09.746202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:09.746482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:09.746757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:09.754157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:09.757376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:17:09.771680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:09.772886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:09.774141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 623/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:09.777518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:09.885976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61946dee-8cee-4db7-a51a-7943d8a7797a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:09.927082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ed9de-62ca-46ee-9d0d-0ae0e94d5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:09.927750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ed9de-62ca-46ee-9d0d-0ae0e94d5e79 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:09.928027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ed9de-62ca-46ee-9d0d-0ae0e94d5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:09.928306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ed9de-62ca-46ee-9d0d-0ae0e94d5e79 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:09.929015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ed9de-62ca-46ee-9d0d-0ae0e94d5e79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:09.929346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ed9de-62ca-46ee-9d0d-0ae0e94d5e79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:09.930773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ed9de-62ca-46ee-9d0d-0ae0e94d5e79 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:09.943929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 636/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:09.950146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:09.978350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:10.064031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2613-f6d4-4a1c-9f56-e5f140460c75 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:10.102493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcbab0-e1db-428d-a293-092b005a16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:10.104739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbab0-e1db-428d-a293-092b005a16bf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:10.104739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbab0-e1db-428d-a293-092b005a16bf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:10.104739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcbab0-e1db-428d-a293-092b005a16bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:10.104739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcbab0-e1db-428d-a293-092b005a16bf None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=ba94572d0db5429ab9275319ef2ee403) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:10.104739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcbab0-e1db-428d-a293-092b005a16bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:10.106152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcbab0-e1db-428d-a293-092b005a16bf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:10.112219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 624/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:17:09 2022] GET /identity/v3/role_assignments?user.id=ba94572d0db5429ab9275319ef2ee403&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=6e8e99de087147e09c760c84a9b30604 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:17:12.361675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8dd0-87d1-4aae-a84d-18bc4599947c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:12.362235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8dd0-87d1-4aae-a84d-18bc4599947c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:12.362235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8dd0-87d1-4aae-a84d-18bc4599947c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:12.363658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 637/1261] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:12.369826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d956-1beb-4642-849f-62cfd1f042b4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:12.370368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d956-1beb-4642-849f-62cfd1f042b4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:12.370462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d956-1beb-4642-849f-62cfd1f042b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:12.391029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-eee5d956-1beb-4642-849f-62cfd1f042b4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:12.392358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eee5d956-1beb-4642-849f-62cfd1f042b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:12.466936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 625/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:12.743409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8dd0-87d1-4aae-a84d-18bc4599947c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:12.755747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:12.850953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8dd0-87d1-4aae-a84d-18bc4599947c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:12.892608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:12.893308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:12.893587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:12.893861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:12.904894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:17:12.909748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:12.911603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:12.912526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 638/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:12.917758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d956-1beb-4642-849f-62cfd1f042b4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:12.935829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:13.020607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d956-1beb-4642-849f-62cfd1f042b4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:13.059653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:13.060274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:13.060549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:13.060822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:13.061494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:13.061793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:13.063253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:13.074703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 626/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:13.080683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:13.149030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:13.182547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574355d-74a2-4b66-b8b7-4c1a1dc01db4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:13.221567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:13.222190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:13.222466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:13.222951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:13.232790 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:13.234245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:13.248548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:13.249735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:13.250644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:13.250644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:13.250644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:13.250644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 639/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 12:17:13.256129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:13.351562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:13.371024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993185-416f-4fd1-a963-476c9c675039 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:13.409171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:13.409803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:13.410251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:13.410581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:13.411574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:13.411879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:13.413267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:13.425241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 627/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:17:13.431911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:13.538165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206596f0-6e47-4c54-af1e-788d95b53cf9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:13.558940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:13.573456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:13.574092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:13.574880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:13.575123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:13.584094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:13.585791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:17:13.596999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:13.598160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:13.603587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 640/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:13.604344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:13.710228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ac82c-504f-4016-a593-9cbed4e3846a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:13.744811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:13.745411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:13.745686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:13.745956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:13.746677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:13.746982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:13.748433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:13.758313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:13.766894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 628/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Sep 26 12:17:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:13.773638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:13.878713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad4f1c-7fea-4e55-964d-543e75419a6f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:13.912698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:13.913326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:13.913601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:13.913869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:13.924226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:13.925661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:13.940457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:13.941613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:13.942599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:13.942599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:13.942599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:13.942599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 641/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:13.948166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:14.053165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180183-96dc-4dbc-b493-cbe93d7ef821 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:14.090108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:14.090721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:14.091001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:14.091273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:14.091956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:14.092259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:14.093634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:14.106199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 629/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:14.111905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:14.145947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:14.213552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e69cfc-0350-40b5-8a03-768bfe9406fe None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:14.247842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:14.248477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:14.248756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:14.249029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:14.256633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:14.258083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:17:14.269998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:14.271148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:14.272322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 642/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:14.281002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:14.351614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:14.395467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d1c88-2528-4510-8eda-13e303c4017d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:14.429909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f9760-034e-4236-8535-6916605226cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:14.430419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9760-034e-4236-8535-6916605226cb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:14.430695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9760-034e-4236-8535-6916605226cb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:14.430963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9760-034e-4236-8535-6916605226cb None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:14.431674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f9760-034e-4236-8535-6916605226cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:14.431974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f9760-034e-4236-8535-6916605226cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:14.433393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f9760-034e-4236-8535-6916605226cb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:14.445237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 630/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:14.451825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:14.547398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:14.556096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63c79e-0389-4a6b-8814-73204d1c2193 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:14.589875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3003e-6e2b-4305-8e08-d1c0133b00f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:14.590756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3003e-6e2b-4305-8e08-d1c0133b00f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:14.591037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3003e-6e2b-4305-8e08-d1c0133b00f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:14.591313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3003e-6e2b-4305-8e08-d1c0133b00f8 None admin] PATH_INFO: `/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/ba94572d0db5429ab9275319ef2ee403/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:14.593226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3003e-6e2b-4305-8e08-d1c0133b00f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc54ce22d0674d7f9774cc34d11b93cc, user_id=ba94572d0db5429ab9275319ef2ee403, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:14.594640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3003e-6e2b-4305-8e08-d1c0133b00f8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:14.836785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 643/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Sep 26 12:17:14 2022] PUT /identity/v3/projects/dc54ce22d0674d7f9774cc34d11b93cc/users/ba94572d0db5429ab9275319ef2ee403/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:17:17.054621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c5aa-18e6-4bc4-86ce-375e16624262 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:17.055192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c5aa-18e6-4bc4-86ce-375e16624262 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:17.055192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c5aa-18e6-4bc4-86ce-375e16624262 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:17.056522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 631/1274] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:17.061891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2791d-7f80-49b0-ae51-be4a3ee37185 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:17.062314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2791d-7f80-49b0-ae51-be4a3ee37185 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:17.062450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2791d-7f80-49b0-ae51-be4a3ee37185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:17.081787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-adf2791d-7f80-49b0-ae51-be4a3ee37185 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:17.083927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-adf2791d-7f80-49b0-ae51-be4a3ee37185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:17.166687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 644/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:17.440803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c5aa-18e6-4bc4-86ce-375e16624262 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:17.550942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c5aa-18e6-4bc4-86ce-375e16624262 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:17.568382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:17.585225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:17.585848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:17.586123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:17.586415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:17.596471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 12:17:17.601925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:17.607703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:17.608681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 632/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Sep 26 12:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:17.609469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2791d-7f80-49b0-ae51-be4a3ee37185 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:17.702144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:17.725247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2791d-7f80-49b0-ae51-be4a3ee37185 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:17.765585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:17.766321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:17.766706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:17.767071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:17.767905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:17.768297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:17.770904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:17.779724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 645/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Sep 26 12:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:17.786394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:17.895449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73782d93-3136-4ca1-8f2f-5b3b19df888a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:17.942806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:17.943484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:17.943764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:17.944032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:17.954732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:17.956146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:17.971104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:17.976067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:17.977177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:17.977177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:17.977177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:17.977177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 633/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:17.978474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:18.080714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934caccc-7df5-4b96-b004-e8d754f45899 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:18.117744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:18.118406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:18.118704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:18.118974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:18.119655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:18.120021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:18.121405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:18.135743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 646/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:18.142604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:18.178723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:18.260985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2217a-5446-442a-ad6c-f01cbed01dec None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:18.298549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:18.299190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:18.299502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:18.299854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:18.307681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:18.309130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 12:17:18.322691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:18.330596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:18.332052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 634/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:18.333842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:18.334878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:18.434986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6807aed-5550-4d04-b3e0-8c2c5bb44597 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:18.471712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:18.472318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:18.473161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:18.473431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:18.474288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:18.474627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:18.476211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:18.497272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 647/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Sep 26 12:17:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:18.506100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:18.613565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:18.623658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d675ef-3383-455b-a436-7e3a5fed1cee None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:18.662407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:18.663026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:18.663313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:18.663617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:18.738723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:18.740307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:18.837243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:18.847570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 635/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Sep 26 12:17:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 12:17:18.853672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:18.927027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:18.971187 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafdd572-936a-42e2-b177-cedb9fda7a47 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:19.007946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:19.008581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:19.008859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:19.009126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:19.021864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:19.023333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 12:17:19.038695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:19.039936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 12:17:19.040919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 12:17:19.040919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 12:17:19.040919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:19.040919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 648/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:19.045578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:19.161285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b994bf-2d09-4828-a5b1-cdab034962aa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:19.196807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427a94-85de-4366-80df-793059700707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:19.197342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427a94-85de-4366-80df-793059700707 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:19.197623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427a94-85de-4366-80df-793059700707 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:19.197899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54427a94-85de-4366-80df-793059700707 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:19.198547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427a94-85de-4366-80df-793059700707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:19.198852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427a94-85de-4366-80df-793059700707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:19.200262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54427a94-85de-4366-80df-793059700707 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:19.211668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 636/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Sep 26 12:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:19.220082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:19.327245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46c2d8-2b66-43ac-8a17-ab9dfafdba03 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:19.341856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:19.361682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:19.362303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:19.362589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:19.362858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:19.370634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:19.372102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 12:17:19.384749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:19.385826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Sep 26 12:17:19.387027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 649/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Sep 26 12:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:19.392255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427a94-85de-4366-80df-793059700707 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:19.441908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:19.490858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54427a94-85de-4366-80df-793059700707 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:19.523956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb78f4b-222a-4840-bb7b-81af865205f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:19.524556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78f4b-222a-4840-bb7b-81af865205f0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:19.524835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78f4b-222a-4840-bb7b-81af865205f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:19.525098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78f4b-222a-4840-bb7b-81af865205f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:19.525773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb78f4b-222a-4840-bb7b-81af865205f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:19.526070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb78f4b-222a-4840-bb7b-81af865205f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:19.527516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb78f4b-222a-4840-bb7b-81af865205f0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:19.541034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 637/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Sep 26 12:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:19.547244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:19.647143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a3e79-f763-4fb6-9449-7da2b5b274ef None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:19.682143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33dc6-4c11-43a4-9cff-66c2e0728104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:19.682829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33dc6-4c11-43a4-9cff-66c2e0728104 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:19.683017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33dc6-4c11-43a4-9cff-66c2e0728104 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:19.683290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33dc6-4c11-43a4-9cff-66c2e0728104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:19.684043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33dc6-4c11-43a4-9cff-66c2e0728104 None admin] RBAC: Adding query filter params (role.id=6e8e99de087147e09c760c84a9b30604, scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc, user.id=ba94572d0db5429ab9275319ef2ee403) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:19.684350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33dc6-4c11-43a4-9cff-66c2e0728104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:19.685762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33dc6-4c11-43a4-9cff-66c2e0728104 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:19.692423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 650/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Sep 26 12:17:19 2022] GET /identity/v3/role_assignments?user.id=ba94572d0db5429ab9275319ef2ee403&scope.project.id=dc54ce22d0674d7f9774cc34d11b93cc&role.id=6e8e99de087147e09c760c84a9b30604 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:21.939834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4841eb-fdc2-4558-9c1b-cd26db91ea66 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:21.940522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4841eb-fdc2-4558-9c1b-cd26db91ea66 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:21.940522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4841eb-fdc2-4558-9c1b-cd26db91ea66 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:21.942445 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 638/1288] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:21.947661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712260a-9103-47bd-a804-62b35fc4b7e0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:21.950153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712260a-9103-47bd-a804-62b35fc4b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:21.950153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712260a-9103-47bd-a804-62b35fc4b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:21.967246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a712260a-9103-47bd-a804-62b35fc4b7e0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:21.968465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a712260a-9103-47bd-a804-62b35fc4b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:21.998146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:22.035305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 651/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:22.308665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4841eb-fdc2-4558-9c1b-cd26db91ea66 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:22.427131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4841eb-fdc2-4558-9c1b-cd26db91ea66 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:22.438159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:22.462305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:22.462936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:22.463227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:22.463511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:22.464092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:22.465445 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:22.474362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:22.475765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:22.476980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 639/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:17:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:22.481713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712260a-9103-47bd-a804-62b35fc4b7e0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:22.583254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712260a-9103-47bd-a804-62b35fc4b7e0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:22.618458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f676-afa9-4959-ba42-a77a668688f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:22.619069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f676-afa9-4959-ba42-a77a668688f2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:22.619410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f676-afa9-4959-ba42-a77a668688f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:22.619692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f676-afa9-4959-ba42-a77a668688f2 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:22.620324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f676-afa9-4959-ba42-a77a668688f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:22.620629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f676-afa9-4959-ba42-a77a668688f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:22.621991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f676-afa9-4959-ba42-a77a668688f2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:22.626755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 652/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Sep 26 12:17:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:22.632862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:22.741797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ce8dc-3126-485c-a5bf-fc0f4407709b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:22.778833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689ca3a-b8db-4039-a18e-b60d153993cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:22.779467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ca3a-b8db-4039-a18e-b60d153993cd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:22.779742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ca3a-b8db-4039-a18e-b60d153993cd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:22.780007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689ca3a-b8db-4039-a18e-b60d153993cd None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:22.780630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689ca3a-b8db-4039-a18e-b60d153993cd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:22.780921 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689ca3a-b8db-4039-a18e-b60d153993cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:22.782278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689ca3a-b8db-4039-a18e-b60d153993cd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:22.787321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 640/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Sep 26 12:17:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:25.004921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d0dd-865a-4eba-b1fc-7aec65275ef1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:25.005482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d0dd-865a-4eba-b1fc-7aec65275ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:25.005482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8d0dd-865a-4eba-b1fc-7aec65275ef1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:25.006805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 653/1293] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:25.012372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5fa17-83ac-48dd-bedd-15ef238acdd2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:25.012805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5fa17-83ac-48dd-bedd-15ef238acdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:25.012907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5fa17-83ac-48dd-bedd-15ef238acdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:25.031457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9ea5fa17-83ac-48dd-bedd-15ef238acdd2 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:25.034256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9ea5fa17-83ac-48dd-bedd-15ef238acdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:25.068016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:25.105636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 641/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:25.380991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d0dd-865a-4eba-b1fc-7aec65275ef1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:25.414193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:25.485298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8d0dd-865a-4eba-b1fc-7aec65275ef1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:25.519156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4267-18ee-4465-8c07-14658ab99d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:25.520575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4267-18ee-4465-8c07-14658ab99d93 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:25.520862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4267-18ee-4465-8c07-14658ab99d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:25.521140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4267-18ee-4465-8c07-14658ab99d93 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:25.521807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae4267-18ee-4465-8c07-14658ab99d93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:25.523167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae4267-18ee-4465-8c07-14658ab99d93 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:25.666212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 654/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Sep 26 12:17:25 2022] POST /identity/v3/services => generated 246 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:17:27.947571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be4ed-b9ac-43de-9420-c186f727b1e8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:27.948188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be4ed-b9ac-43de-9420-c186f727b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:27.948188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45be4ed-b9ac-43de-9420-c186f727b1e8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:27.949546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 642/1296] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:27.955150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568ef59-37eb-415d-9609-d57b522dc245 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:27.955680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568ef59-37eb-415d-9609-d57b522dc245 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:27.955779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568ef59-37eb-415d-9609-d57b522dc245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:27.975237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b568ef59-37eb-415d-9609-d57b522dc245 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:27.976548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b568ef59-37eb-415d-9609-d57b522dc245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:28.058737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 655/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:28.341379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be4ed-b9ac-43de-9420-c186f727b1e8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:28.444883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45be4ed-b9ac-43de-9420-c186f727b1e8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:28.479230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:28.479883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:28.480160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:28.480435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:28.481011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:28.482370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:28.491387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:28.492607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:28.493691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 643/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:17:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:28.498557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568ef59-37eb-415d-9609-d57b522dc245 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:28.518370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:28.598001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568ef59-37eb-415d-9609-d57b522dc245 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:28.631672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:28.632280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:28.632559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:28.632828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:28.633456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:28.633798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:28.635160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:28.640698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 656/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Sep 26 12:17:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:28.647779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:28.679037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:28.748046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472d091-9848-4ffb-b719-8212ba01c169 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:28.784166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b700-3628-43b6-9a5f-aa0cc584b797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:28.785435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b700-3628-43b6-9a5f-aa0cc584b797 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:28.785717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b700-3628-43b6-9a5f-aa0cc584b797 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:28.785990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b700-3628-43b6-9a5f-aa0cc584b797 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:28.786692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b700-3628-43b6-9a5f-aa0cc584b797 None admin] RBAC: Adding query filter params (interface=public, service_id=5583797245f54f59910bc46129616159, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:28.787000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b700-3628-43b6-9a5f-aa0cc584b797 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:28.788521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b700-3628-43b6-9a5f-aa0cc584b797 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:28.793518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 644/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Sep 26 12:17:28 2022] GET /identity/v3/endpoints?service_id=5583797245f54f59910bc46129616159&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:28.799466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:28.881984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:28.900287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c19d06-43d2-4df0-9a41-79f4907f7eeb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:28.933619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4eddf-208b-408c-bfc0-c8bcfd08c45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:28.934207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4eddf-208b-408c-bfc0-c8bcfd08c45d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:28.934484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4eddf-208b-408c-bfc0-c8bcfd08c45d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:28.934754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4eddf-208b-408c-bfc0-c8bcfd08c45d None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:28.935366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4eddf-208b-408c-bfc0-c8bcfd08c45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:28.936758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4eddf-208b-408c-bfc0-c8bcfd08c45d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:28.943498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 657/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Sep 26 12:17:28 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:17:31.170428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221257-9fc2-4b2a-96d6-91443f24f413 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:31.170951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221257-9fc2-4b2a-96d6-91443f24f413 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:31.171071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221257-9fc2-4b2a-96d6-91443f24f413 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:31.172340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 645/1302] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:17:31.177559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed39-a330-4a7a-9e9b-85267ddbf96d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:31.178057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed39-a330-4a7a-9e9b-85267ddbf96d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:31.178158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ed39-a330-4a7a-9e9b-85267ddbf96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:31.196049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ee72ed39-a330-4a7a-9e9b-85267ddbf96d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:17:31.197255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ee72ed39-a330-4a7a-9e9b-85267ddbf96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:17:31.267417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 658/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:17:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 12:17:31.583698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221257-9fc2-4b2a-96d6-91443f24f413 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:31.706072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:31.714036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221257-9fc2-4b2a-96d6-91443f24f413 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:31.758874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:31.759583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:31.759863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:31.760138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:31.760760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:31.762397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 12:17:31.775476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 12:17:31.777402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Sep 26 12:17:31.779684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 646/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Sep 26 12:17:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 12:17:31.786105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72ed39-a330-4a7a-9e9b-85267ddbf96d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:31.884636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:31.922954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72ed39-a330-4a7a-9e9b-85267ddbf96d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:31.965230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a001-4377-4b7d-94e6-1c895538deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:31.965846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a001-4377-4b7d-94e6-1c895538deb5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:31.966128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a001-4377-4b7d-94e6-1c895538deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:31.966398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a001-4377-4b7d-94e6-1c895538deb5 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:31.967037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a001-4377-4b7d-94e6-1c895538deb5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:17:31.967370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a001-4377-4b7d-94e6-1c895538deb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:31.968741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a001-4377-4b7d-94e6-1c895538deb5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:31.977353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 659/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Sep 26 12:17:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:17:31.983626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:17:32.104327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e157-9297-4ab2-acfd-827069398541 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:17:32.150179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a58e2f-89ea-41c3-a0a5-9159149eaf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:17:32.150714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58e2f-89ea-41c3-a0a5-9159149eaf2a None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:17:32.150992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58e2f-89ea-41c3-a0a5-9159149eaf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:17:32.151261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a58e2f-89ea-41c3-a0a5-9159149eaf2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:17:32.152019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a58e2f-89ea-41c3-a0a5-9159149eaf2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:17:32.153719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a58e2f-89ea-41c3-a0a5-9159149eaf2a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:17:32.277546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 647/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:17:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:17:41.972259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=30 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:17:42.272654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:40.490368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2113377-256d-444b-bf46-51d57cb58a56 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:40.490948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2113377-256d-444b-bf46-51d57cb58a56 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:40.490948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2113377-256d-444b-bf46-51d57cb58a56 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:40.497878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda368c7-6cc8-462c-ba5e-6dba9f54722f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:40.498754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda368c7-6cc8-462c-ba5e-6dba9f54722f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:40.499187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda368c7-6cc8-462c-ba5e-6dba9f54722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:40.504095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 660/1307] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:25:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:25:40.589384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-eda368c7-6cc8-462c-ba5e-6dba9f54722f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:25:40.590918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eda368c7-6cc8-462c-ba5e-6dba9f54722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:40.843397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 648/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:25:41.231375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abcd99-892e-4336-abc0-277678a5da9e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:41.232047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abcd99-892e-4336-abc0-277678a5da9e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:41.232604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abcd99-892e-4336-abc0-277678a5da9e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:41.235036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 661/1309] 10.222.0.49 () {54 vars in 964 bytes} [Mon Sep 26 12:25:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:25:41.242191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2b139-f29c-414f-962c-b66fff26a487 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:41.242751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2b139-f29c-414f-962c-b66fff26a487 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:41.243203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2b139-f29c-414f-962c-b66fff26a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:41.364374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cef2b139-f29c-414f-962c-b66fff26a487 None None] MFA Rules not processed for user `5c06385b20074363b3a5f7216947280b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:25:41.366784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cef2b139-f29c-414f-962c-b66fff26a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:41.405253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:41.481781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 649/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Mon Sep 26 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:25:41.491825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abcd99-892e-4336-abc0-277678a5da9e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:25:41.494415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-59abcd99-892e-4336-abc0-277678a5da9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:41.635090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abcd99-892e-4336-abc0-277678a5da9e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:25:41.725141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eecfe-8419-4f54-8048-5c502bc951c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:25:41.725683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eecfe-8419-4f54-8048-5c502bc951c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:41.725963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eecfe-8419-4f54-8048-5c502bc951c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:41.726233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eecfe-8419-4f54-8048-5c502bc951c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:41.727949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-463eecfe-8419-4f54-8048-5c502bc951c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:41.792482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:41.859728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eecfe-8419-4f54-8048-5c502bc951c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:25:41.861135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463eecfe-8419-4f54-8048-5c502bc951c2 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:25:41.898111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 662/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:25:44.500385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb31e6-5444-4d62-a7d2-99c1238e18e8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:44.500937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb31e6-5444-4d62-a7d2-99c1238e18e8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:44.500937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb31e6-5444-4d62-a7d2-99c1238e18e8 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:44.502318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 650/1312] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:25:44.509371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec2e35-bc0f-4c53-bd9a-98286e3cbd12 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:44.510014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec2e35-bc0f-4c53-bd9a-98286e3cbd12 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:44.510014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec2e35-bc0f-4c53-bd9a-98286e3cbd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:44.620023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-24ec2e35-bc0f-4c53-bd9a-98286e3cbd12 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:25:44.621221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-24ec2e35-bc0f-4c53-bd9a-98286e3cbd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:44.726466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 663/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:25:45.020272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb31e6-5444-4d62-a7d2-99c1238e18e8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:25:45.022413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3deb31e6-5444-4d62-a7d2-99c1238e18e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:45.137408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb31e6-5444-4d62-a7d2-99c1238e18e8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:25:45.220397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:45.223914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f19f0-23c1-4116-b96a-9aa4ff50c961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:25:45.224768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f19f0-23c1-4116-b96a-9aa4ff50c961 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:45.225225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f19f0-23c1-4116-b96a-9aa4ff50c961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:45.225667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f19f0-23c1-4116-b96a-9aa4ff50c961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:45.228663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8d5f19f0-23c1-4116-b96a-9aa4ff50c961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:45.366173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f19f0-23c1-4116-b96a-9aa4ff50c961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:25:45.367676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f19f0-23c1-4116-b96a-9aa4ff50c961 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:25:45.389667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 651/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:25:48.152804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d50dd-5ce7-4eb7-9046-199a8be671f9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:48.153395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d50dd-5ce7-4eb7-9046-199a8be671f9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:48.153395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d50dd-5ce7-4eb7-9046-199a8be671f9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:48.154705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 664/1315] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:25:48.160308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed467-21b9-4138-88e3-2b6f40e77f70 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:48.160795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed467-21b9-4138-88e3-2b6f40e77f70 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:48.161022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed467-21b9-4138-88e3-2b6f40e77f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:48.234426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f25ed467-21b9-4138-88e3-2b6f40e77f70 None None] MFA Rules not processed for user `d31177bfd20d4a24b2ad2d6532971805`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:25:48.235678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f25ed467-21b9-4138-88e3-2b6f40e77f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:48.291660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:48.347871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 652/1316] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:25:48.653922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d50dd-5ce7-4eb7-9046-199a8be671f9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:25:48.655574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ff4d50dd-5ce7-4eb7-9046-199a8be671f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:48.668295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:48.770918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d50dd-5ce7-4eb7-9046-199a8be671f9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:25:48.850121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f1439-729c-4f47-96f8-ed9d8b1499dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:25:48.850729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1439-729c-4f47-96f8-ed9d8b1499dd service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:48.851008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1439-729c-4f47-96f8-ed9d8b1499dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:48.851280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f1439-729c-4f47-96f8-ed9d8b1499dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:48.852938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5c9f1439-729c-4f47-96f8-ed9d8b1499dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:48.916454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:48.967036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f1439-729c-4f47-96f8-ed9d8b1499dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:25:48.968566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f1439-729c-4f47-96f8-ed9d8b1499dd service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:25:48.987883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 665/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:25:52.089730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4680-a39a-47ff-ac62-98a5ef71f566 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:52.090434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4680-a39a-47ff-ac62-98a5ef71f566 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:52.090434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d4680-a39a-47ff-ac62-98a5ef71f566 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:52.091742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 653/1318] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:25:52.097968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f8d6-aa36-4454-8e5c-1c17c36c7a0b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:52.098621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f8d6-aa36-4454-8e5c-1c17c36c7a0b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:52.098621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0f8d6-aa36-4454-8e5c-1c17c36c7a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:52.174908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6fd0f8d6-aa36-4454-8e5c-1c17c36c7a0b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:25:52.176194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6fd0f8d6-aa36-4454-8e5c-1c17c36c7a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:52.288821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 666/1319] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:25:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:25:52.585565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d4680-a39a-47ff-ac62-98a5ef71f566 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:25:52.589827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f10d4680-a39a-47ff-ac62-98a5ef71f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:52.722308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d4680-a39a-47ff-ac62-98a5ef71f566 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:25:52.807929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972937a-a8d8-4d4d-bab6-672701e4ab7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:25:52.808551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972937a-a8d8-4d4d-bab6-672701e4ab7c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:52.808833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972937a-a8d8-4d4d-bab6-672701e4ab7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:52.809103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972937a-a8d8-4d4d-bab6-672701e4ab7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:52.810801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b972937a-a8d8-4d4d-bab6-672701e4ab7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:52.819798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:52.939534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972937a-a8d8-4d4d-bab6-672701e4ab7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:25:52.940998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972937a-a8d8-4d4d-bab6-672701e4ab7c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:25:52.961052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 654/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:25:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:25:56.378691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122bf8-2d7f-4624-8278-ea1638a90a40 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:56.379227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122bf8-2d7f-4624-8278-ea1638a90a40 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:56.379309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122bf8-2d7f-4624-8278-ea1638a90a40 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:56.381186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 667/1321] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:25:56.387108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbebb29-b638-426e-9d35-468fae0cee91 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:56.387624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbebb29-b638-426e-9d35-468fae0cee91 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:56.387783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbebb29-b638-426e-9d35-468fae0cee91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:56.468612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2cbebb29-b638-426e-9d35-468fae0cee91 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:25:56.469839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2cbebb29-b638-426e-9d35-468fae0cee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:56.538026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:56.585232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 655/1322] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:25:56.881533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122bf8-2d7f-4624-8278-ea1638a90a40 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:25:56.882982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ba122bf8-2d7f-4624-8278-ea1638a90a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:56.908485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:57.018281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122bf8-2d7f-4624-8278-ea1638a90a40 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:25:57.116403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c41e46-cca8-43a5-be91-8e19d3445abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:25:57.117083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41e46-cca8-43a5-be91-8e19d3445abd service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:57.117410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41e46-cca8-43a5-be91-8e19d3445abd service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:57.117782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41e46-cca8-43a5-be91-8e19d3445abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:57.119645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e1c41e46-cca8-43a5-be91-8e19d3445abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:57.235413 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:25:57.300764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c41e46-cca8-43a5-be91-8e19d3445abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:25:57.303528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c41e46-cca8-43a5-be91-8e19d3445abd service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:25:57.325293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 668/1323] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:25:59.686408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf720c67-5fcb-4cf7-85f3-8f780cc26874 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:59.686971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf720c67-5fcb-4cf7-85f3-8f780cc26874 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:59.687094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf720c67-5fcb-4cf7-85f3-8f780cc26874 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:59.688680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 656/1324] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:25:59.695683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f4af1-f94d-4e6e-9ad7-72075f6a5ea0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:25:59.696221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f4af1-f94d-4e6e-9ad7-72075f6a5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:25:59.696410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f4af1-f94d-4e6e-9ad7-72075f6a5ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:25:59.780862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f44f4af1-f94d-4e6e-9ad7-72075f6a5ea0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:25:59.782109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f44f4af1-f94d-4e6e-9ad7-72075f6a5ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:25:59.900342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 669/1325] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:00.213375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b54073-c922-4b16-92d9-e9bd3febadd4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:00.213816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b54073-c922-4b16-92d9-e9bd3febadd4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:00.214225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b54073-c922-4b16-92d9-e9bd3febadd4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:00.215925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 657/1326] 10.222.0.49 () {54 vars in 964 bytes} [Mon Sep 26 12:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:26:00.222736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3eda-13cf-4881-a673-549cbc908f87 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:00.223540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3eda-13cf-4881-a673-549cbc908f87 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:00.223840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe3eda-13cf-4881-a673-549cbc908f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:00.262184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:00.323490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0dfe3eda-13cf-4881-a673-549cbc908f87 None None] MFA Rules not processed for user `5c06385b20074363b3a5f7216947280b`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:00.324609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0dfe3eda-13cf-4881-a673-549cbc908f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:00.413794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 670/1327] 10.222.0.49 () {58 vars in 1061 bytes} [Mon Sep 26 12:26:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:26:00.423493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b54073-c922-4b16-92d9-e9bd3febadd4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:00.425175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-45b54073-c922-4b16-92d9-e9bd3febadd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:00.556203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b54073-c922-4b16-92d9-e9bd3febadd4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:00.647603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237ad7d-47f7-454f-ac0c-453446c2c5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:00.648224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237ad7d-47f7-454f-ac0c-453446c2c5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:00.648500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237ad7d-47f7-454f-ac0c-453446c2c5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:00.648769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237ad7d-47f7-454f-ac0c-453446c2c5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:00.650451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b237ad7d-47f7-454f-ac0c-453446c2c5f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:00.670755 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:00.807279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237ad7d-47f7-454f-ac0c-453446c2c5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:00.809319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237ad7d-47f7-454f-ac0c-453446c2c5f9 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:00.831720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 658/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:03.445583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582bdc-850c-4380-8f31-e0890d870ed1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:03.446125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582bdc-850c-4380-8f31-e0890d870ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:03.446125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7582bdc-850c-4380-8f31-e0890d870ed1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:03.447504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 671/1329] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:03.455298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a26a6-7300-41b1-ae0f-62f459a4a3c8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:03.455841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a26a6-7300-41b1-ae0f-62f459a4a3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:03.455841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a26a6-7300-41b1-ae0f-62f459a4a3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:03.533378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e89a26a6-7300-41b1-ae0f-62f459a4a3c8 None None] MFA Rules not processed for user `d31177bfd20d4a24b2ad2d6532971805`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:03.534754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e89a26a6-7300-41b1-ae0f-62f459a4a3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:03.624967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:03.662306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 659/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:03.958290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582bdc-850c-4380-8f31-e0890d870ed1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:03.960631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7582bdc-850c-4380-8f31-e0890d870ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:04.089937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7582bdc-850c-4380-8f31-e0890d870ed1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:04.111846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:04.171863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50e3df-29e3-463c-8864-bc36cea6ee7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:04.172469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50e3df-29e3-463c-8864-bc36cea6ee7a service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:04.172748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50e3df-29e3-463c-8864-bc36cea6ee7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:04.173016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50e3df-29e3-463c-8864-bc36cea6ee7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:04.174622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6f50e3df-29e3-463c-8864-bc36cea6ee7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:04.297245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50e3df-29e3-463c-8864-bc36cea6ee7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:04.298691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50e3df-29e3-463c-8864-bc36cea6ee7a service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:04.321432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 672/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:07.212042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406db36-976c-42b4-93bb-685407915793 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:07.212577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406db36-976c-42b4-93bb-685407915793 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:07.212577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406db36-976c-42b4-93bb-685407915793 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:07.213820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 660/1332] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:07.219275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d08d-0647-4dbc-a710-55f33f1a33ec None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:07.219756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d08d-0647-4dbc-a710-55f33f1a33ec None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:07.219863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d08d-0647-4dbc-a710-55f33f1a33ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:07.284503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:07.287275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9a53d08d-0647-4dbc-a710-55f33f1a33ec None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:07.288524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9a53d08d-0647-4dbc-a710-55f33f1a33ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:07.395296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 673/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:07.682964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406db36-976c-42b4-93bb-685407915793 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:07.684653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b406db36-976c-42b4-93bb-685407915793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:07.797970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406db36-976c-42b4-93bb-685407915793 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:07.892880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df29f2d-79be-410d-86c9-36e5eef197cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:07.893577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df29f2d-79be-410d-86c9-36e5eef197cd service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:07.893849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df29f2d-79be-410d-86c9-36e5eef197cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:07.894115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df29f2d-79be-410d-86c9-36e5eef197cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:07.896436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5df29f2d-79be-410d-86c9-36e5eef197cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:07.930343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:08.024741 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df29f2d-79be-410d-86c9-36e5eef197cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:08.026204 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df29f2d-79be-410d-86c9-36e5eef197cd service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:08.047670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 661/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:10.328333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f5592-eb03-4456-8b78-d196236ae4f2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:10.328859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f5592-eb03-4456-8b78-d196236ae4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:10.328859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f5592-eb03-4456-8b78-d196236ae4f2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:10.330139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 674/1335] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:10.336236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb8684-8367-44c9-8acf-0a2ec830bf85 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:10.336674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb8684-8367-44c9-8acf-0a2ec830bf85 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:10.336787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb8684-8367-44c9-8acf-0a2ec830bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:10.404238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0dfb8684-8367-44c9-8acf-0a2ec830bf85 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:10.405442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0dfb8684-8367-44c9-8acf-0a2ec830bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:10.482013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:10.504438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 662/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:10.793846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f5592-eb03-4456-8b78-d196236ae4f2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:10.795407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7c3f5592-eb03-4456-8b78-d196236ae4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:10.903153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f5592-eb03-4456-8b78-d196236ae4f2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:10.933895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:10.981391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c426e-9ea7-4f8f-92da-d23559865ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:10.982061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c426e-9ea7-4f8f-92da-d23559865ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:10.982464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c426e-9ea7-4f8f-92da-d23559865ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:10.982579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c426e-9ea7-4f8f-92da-d23559865ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:10.985317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2f4c426e-9ea7-4f8f-92da-d23559865ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:11.129592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c426e-9ea7-4f8f-92da-d23559865ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:11.131224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c426e-9ea7-4f8f-92da-d23559865ec8 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:11.151206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 675/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:13.939726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821842d-6cb1-4d00-876d-b028ad2606cb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:13.940315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821842d-6cb1-4d00-876d-b028ad2606cb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:13.940315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821842d-6cb1-4d00-876d-b028ad2606cb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:13.941713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 663/1338] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:13.947410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef26e-0dea-4b9e-8fcf-da6800dfa880 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:13.947888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef26e-0dea-4b9e-8fcf-da6800dfa880 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:13.947989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efef26e-0dea-4b9e-8fcf-da6800dfa880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:14.017771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2efef26e-0dea-4b9e-8fcf-da6800dfa880 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:14.019000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2efef26e-0dea-4b9e-8fcf-da6800dfa880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:14.028027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:14.118423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 676/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:14.400793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821842d-6cb1-4d00-876d-b028ad2606cb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:14.402327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3821842d-6cb1-4d00-876d-b028ad2606cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:14.512047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821842d-6cb1-4d00-876d-b028ad2606cb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:14.588954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea41ca6-de43-4686-baa2-c73c1bd3930c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:14.589566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41ca6-de43-4686-baa2-c73c1bd3930c service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:14.589844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41ca6-de43-4686-baa2-c73c1bd3930c service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:14.590142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41ca6-de43-4686-baa2-c73c1bd3930c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:14.591856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7ea41ca6-de43-4686-baa2-c73c1bd3930c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:14.631497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:14.725248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea41ca6-de43-4686-baa2-c73c1bd3930c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:14.726697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea41ca6-de43-4686-baa2-c73c1bd3930c service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:14.748561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 664/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:19.472083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8e39e-42ff-4497-81c2-7b40ef3a52a6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:19.473213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8e39e-42ff-4497-81c2-7b40ef3a52a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:19.473213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8e39e-42ff-4497-81c2-7b40ef3a52a6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:19.474540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 677/1341] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:19.480403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04af2bb-34c9-40e4-924e-9beb446e7d7d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:19.481138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04af2bb-34c9-40e4-924e-9beb446e7d7d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:19.481138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04af2bb-34c9-40e4-924e-9beb446e7d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:19.566036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e04af2bb-34c9-40e4-924e-9beb446e7d7d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:19.567310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e04af2bb-34c9-40e4-924e-9beb446e7d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:19.672226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:19.685577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 665/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:19.977253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8e39e-42ff-4497-81c2-7b40ef3a52a6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:19.978808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-96a8e39e-42ff-4497-81c2-7b40ef3a52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:20.090904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8e39e-42ff-4497-81c2-7b40ef3a52a6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:20.131307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:20.170618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f4365-711e-4f4a-a94c-fdf102424b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:20.171142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4365-711e-4f4a-a94c-fdf102424b41 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:20.171451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4365-711e-4f4a-a94c-fdf102424b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:20.171727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4365-711e-4f4a-a94c-fdf102424b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:20.173357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-be6f4365-711e-4f4a-a94c-fdf102424b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:20.307119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f4365-711e-4f4a-a94c-fdf102424b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:20.308608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f4365-711e-4f4a-a94c-fdf102424b41 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:20.327775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 678/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:23.580844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e186a0-97d9-49a2-aab6-514e9b48ddc2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:23.581460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e186a0-97d9-49a2-aab6-514e9b48ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:23.581460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e186a0-97d9-49a2-aab6-514e9b48ddc2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:23.582673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 666/1344] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:23.588075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415c1e-039d-4c07-8939-0f967e56c091 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:23.588514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415c1e-039d-4c07-8939-0f967e56c091 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:23.588613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415c1e-039d-4c07-8939-0f967e56c091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:23.654867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-df415c1e-039d-4c07-8939-0f967e56c091 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:23.656115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-df415c1e-039d-4c07-8939-0f967e56c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:23.676569 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:23.764739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 679/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:24.062329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e186a0-97d9-49a2-aab6-514e9b48ddc2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:24.064753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b6e186a0-97d9-49a2-aab6-514e9b48ddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:24.191677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e186a0-97d9-49a2-aab6-514e9b48ddc2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:24.274438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf186-6a3d-4313-9b9b-00164916e16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:24.275246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf186-6a3d-4313-9b9b-00164916e16f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:24.275414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf186-6a3d-4313-9b9b-00164916e16f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:24.275665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf186-6a3d-4313-9b9b-00164916e16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:24.277320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ddecf186-6a3d-4313-9b9b-00164916e16f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:24.325666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:24.402871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf186-6a3d-4313-9b9b-00164916e16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:24.404465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf186-6a3d-4313-9b9b-00164916e16f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:24.428567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 667/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:28.982550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b6ab-1393-4257-a457-bf95e16f42a0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:28.983055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b6ab-1393-4257-a457-bf95e16f42a0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:28.983173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b6ab-1393-4257-a457-bf95e16f42a0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:28.984471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 680/1347] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:28.990357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff522c-9610-4be1-9093-8fefd29b6755 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:28.990849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff522c-9610-4be1-9093-8fefd29b6755 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:28.990962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff522c-9610-4be1-9093-8fefd29b6755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:29.071453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a5ff522c-9610-4be1-9093-8fefd29b6755 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:29.072719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5ff522c-9610-4be1-9093-8fefd29b6755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:29.181514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:29.187462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 668/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:29.467399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b6ab-1393-4257-a457-bf95e16f42a0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:29.468934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cf30b6ab-1393-4257-a457-bf95e16f42a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:29.572506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b6ab-1393-4257-a457-bf95e16f42a0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:29.619825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:29.646241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92af2b-e706-4320-acdf-f8b38e937dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:29.646842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92af2b-e706-4320-acdf-f8b38e937dbc service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:29.647117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92af2b-e706-4320-acdf-f8b38e937dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:29.647414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92af2b-e706-4320-acdf-f8b38e937dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:29.649035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fc92af2b-e706-4320-acdf-f8b38e937dbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:29.761986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92af2b-e706-4320-acdf-f8b38e937dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:29.763517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92af2b-e706-4320-acdf-f8b38e937dbc service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:29.783996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 681/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:34.999016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9e307-dc1d-4cfb-80fd-8912c3d8bcd4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:34.999586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9e307-dc1d-4cfb-80fd-8912c3d8bcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:34.999586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9e307-dc1d-4cfb-80fd-8912c3d8bcd4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:35.001327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 669/1350] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:35.007818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb322-18fb-4310-9892-028a20cea134 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:35.008459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb322-18fb-4310-9892-028a20cea134 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:35.008459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb322-18fb-4310-9892-028a20cea134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:35.140960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3fdcb322-18fb-4310-9892-028a20cea134 None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:35.142746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3fdcb322-18fb-4310-9892-028a20cea134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:35.167225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:35.374413 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 682/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:39.781120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcac340-b053-4328-ab0c-c3e005477bb4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:39.781655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcac340-b053-4328-ab0c-c3e005477bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:39.781655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcac340-b053-4328-ab0c-c3e005477bb4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:39.783208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 670/1352] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:39.788748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e68f4-9876-4cf9-8322-41c38dbdf15c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:39.789260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e68f4-9876-4cf9-8322-41c38dbdf15c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:39.789369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e68f4-9876-4cf9-8322-41c38dbdf15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:39.876799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2d4e68f4-9876-4cf9-8322-41c38dbdf15c None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:39.878489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2d4e68f4-9876-4cf9-8322-41c38dbdf15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:39.960049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:40.002109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 683/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:41.890642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fb22-b188-4c45-889f-da923adaad7f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:41.891194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fb22-b188-4c45-889f-da923adaad7f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:41.891417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fb22-b188-4c45-889f-da923adaad7f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:41.892804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 671/1354] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:41.899638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5c72-8f21-4cf8-af0f-a595e5557290 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:41.900108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5c72-8f21-4cf8-af0f-a595e5557290 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:41.900205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5c72-8f21-4cf8-af0f-a595e5557290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:41.984219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-645c5c72-8f21-4cf8-af0f-a595e5557290 None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:41.985530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-645c5c72-8f21-4cf8-af0f-a595e5557290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:42.122297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 684/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:45.578835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83838a-03c9-4962-81b9-bdb165af1488 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:45.580055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83838a-03c9-4962-81b9-bdb165af1488 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:45.580055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83838a-03c9-4962-81b9-bdb165af1488 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:45.583094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 672/1356] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:45.593330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010087fe-b0a3-48ca-a947-4e664ff7cbaf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:45.593959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010087fe-b0a3-48ca-a947-4e664ff7cbaf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:45.594348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010087fe-b0a3-48ca-a947-4e664ff7cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:45.666325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:45.713526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-010087fe-b0a3-48ca-a947-4e664ff7cbaf None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:45.715547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-010087fe-b0a3-48ca-a947-4e664ff7cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:45.828123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 685/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:46.136713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09bd3-aab2-41d6-9441-a107a793d304 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:46.136989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09bd3-aab2-41d6-9441-a107a793d304 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:46.137697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09bd3-aab2-41d6-9441-a107a793d304 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:46.139181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 673/1358] 10.222.0.49 () {54 vars in 961 bytes} [Mon Sep 26 12:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:46.147678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff1686-d769-46ef-9cdd-2a09501050b2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:46.148311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff1686-d769-46ef-9cdd-2a09501050b2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:46.149071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff1686-d769-46ef-9cdd-2a09501050b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:46.250815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4cff1686-d769-46ef-9cdd-2a09501050b2 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:46.252065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4cff1686-d769-46ef-9cdd-2a09501050b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:46.307252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:46.385230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 686/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Sep 26 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:46.392933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09bd3-aab2-41d6-9441-a107a793d304 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:46.394663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-16d09bd3-aab2-41d6-9441-a107a793d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:46.555685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09bd3-aab2-41d6-9441-a107a793d304 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:46.635368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:46.678505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1301c-3042-4ba2-acef-72d64a8aae71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:46.679281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1301c-3042-4ba2-acef-72d64a8aae71 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:46.679705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1301c-3042-4ba2-acef-72d64a8aae71 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:46.680086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1301c-3042-4ba2-acef-72d64a8aae71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:46.681688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-26a1301c-3042-4ba2-acef-72d64a8aae71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:46.796892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1301c-3042-4ba2-acef-72d64a8aae71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:46.798583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1301c-3042-4ba2-acef-72d64a8aae71 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:46.823882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 674/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:49.421613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d4e3-dce7-4e11-a453-de38a35a1264 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:49.422177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d4e3-dce7-4e11-a453-de38a35a1264 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:49.422177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d4e3-dce7-4e11-a453-de38a35a1264 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:49.423719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 687/1361] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:49.430044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831cc36-f234-440e-bb07-4fd865dbe9a6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:49.430522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831cc36-f234-440e-bb07-4fd865dbe9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:49.430598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831cc36-f234-440e-bb07-4fd865dbe9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:49.506022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f831cc36-f234-440e-bb07-4fd865dbe9a6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:49.507274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f831cc36-f234-440e-bb07-4fd865dbe9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:49.558073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:49.640302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 675/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:49.947268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373d4e3-dce7-4e11-a453-de38a35a1264 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:49.949332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b373d4e3-dce7-4e11-a453-de38a35a1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:50.133095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373d4e3-dce7-4e11-a453-de38a35a1264 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:50.146620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:50.285235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acb133-f5fb-4bd4-9e83-f277e86bd935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:50.285990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acb133-f5fb-4bd4-9e83-f277e86bd935 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:50.286468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acb133-f5fb-4bd4-9e83-f277e86bd935 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:50.286875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acb133-f5fb-4bd4-9e83-f277e86bd935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:50.289907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f6acb133-f5fb-4bd4-9e83-f277e86bd935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:50.401483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acb133-f5fb-4bd4-9e83-f277e86bd935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:50.403138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acb133-f5fb-4bd4-9e83-f277e86bd935 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:50.422900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 688/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:53.113388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526e0b-8185-493a-a451-5993081045c7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:53.113931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526e0b-8185-493a-a451-5993081045c7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:53.114248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de526e0b-8185-493a-a451-5993081045c7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:53.116179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 676/1364] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:53.121806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1e5de-2e68-481b-ac39-91c5693b7920 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:53.122353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1e5de-2e68-481b-ac39-91c5693b7920 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:53.122353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1e5de-2e68-481b-ac39-91c5693b7920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:53.140519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:53.212996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bad1e5de-2e68-481b-ac39-91c5693b7920 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:53.214280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bad1e5de-2e68-481b-ac39-91c5693b7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:53.355465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 689/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:53.658789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870077d-752d-4508-ba78-d24e66180ab9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:53.659230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870077d-752d-4508-ba78-d24e66180ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:53.659642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870077d-752d-4508-ba78-d24e66180ab9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:53.661164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 677/1366] 10.222.0.49 () {54 vars in 961 bytes} [Mon Sep 26 12:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:53.668879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9940e-53a7-4440-9cc9-214a872fb7f4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:53.672967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9940e-53a7-4440-9cc9-214a872fb7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:53.672967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9940e-53a7-4440-9cc9-214a872fb7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:53.781736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-47b9940e-53a7-4440-9cc9-214a872fb7f4 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:53.782977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-47b9940e-53a7-4440-9cc9-214a872fb7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:53.836598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:53.930687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 690/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Sep 26 12:26:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:53.938975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870077d-752d-4508-ba78-d24e66180ab9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:53.941265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0870077d-752d-4508-ba78-d24e66180ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:54.182434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870077d-752d-4508-ba78-d24e66180ab9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:54.208907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:54.211002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431baa4-c3cf-4957-8486-a7e0d3a45ec0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:54.211509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431baa4-c3cf-4957-8486-a7e0d3a45ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:54.211608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431baa4-c3cf-4957-8486-a7e0d3a45ec0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:54.213251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 691/1368] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:54.219690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e2494-c34e-43a8-a5cc-29ce7b643534 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:54.220008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e2494-c34e-43a8-a5cc-29ce7b643534 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:54.220253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e2494-c34e-43a8-a5cc-29ce7b643534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:54.300850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-833e2494-c34e-43a8-a5cc-29ce7b643534 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:54.302205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-833e2494-c34e-43a8-a5cc-29ce7b643534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:54.325788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed77b3-b552-4e6f-8d7b-e38aab8668db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:54.326566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed77b3-b552-4e6f-8d7b-e38aab8668db service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:54.326960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed77b3-b552-4e6f-8d7b-e38aab8668db service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:54.327354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed77b3-b552-4e6f-8d7b-e38aab8668db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:54.329108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-71ed77b3-b552-4e6f-8d7b-e38aab8668db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:54.432269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:54.443580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 692/1369] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:26:54.452838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed77b3-b552-4e6f-8d7b-e38aab8668db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:54.457192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed77b3-b552-4e6f-8d7b-e38aab8668db service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:54.496725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 678/1370] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:54.801811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db770-5ffe-4c52-a495-e601e24ecd06 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:54.801811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db770-5ffe-4c52-a495-e601e24ecd06 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:54.801811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45db770-5ffe-4c52-a495-e601e24ecd06 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:54.801811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 693/1371] 10.222.0.49 () {54 vars in 963 bytes} [Mon Sep 26 12:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:54.802830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54292c1-6f33-48e2-bf2c-c2b427eb5259 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:54.802830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54292c1-6f33-48e2-bf2c-c2b427eb5259 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:54.802830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54292c1-6f33-48e2-bf2c-c2b427eb5259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:54.842046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:54.928746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c54292c1-6f33-48e2-bf2c-c2b427eb5259 None None] MFA Rules not processed for user `91af8e7c2dcd41e480e1b1a086ba2688`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:54.930696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c54292c1-6f33-48e2-bf2c-c2b427eb5259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:55.029255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 679/1372] 10.222.0.49 () {58 vars in 1060 bytes} [Mon Sep 26 12:26:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:55.032107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db770-5ffe-4c52-a495-e601e24ecd06 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:55.034453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d45db770-5ffe-4c52-a495-e601e24ecd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:55.173797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45db770-5ffe-4c52-a495-e601e24ecd06 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:55.279994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a3114-b5d9-4647-bf59-c2e8371705f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:55.280649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3114-b5d9-4647-bf59-c2e8371705f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:55.280818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3114-b5d9-4647-bf59-c2e8371705f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:55.281061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a3114-b5d9-4647-bf59-c2e8371705f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:55.282783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f57a3114-b5d9-4647-bf59-c2e8371705f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:55.346720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:55.423644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a3114-b5d9-4647-bf59-c2e8371705f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:55.425805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a3114-b5d9-4647-bf59-c2e8371705f9 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:55.448190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 694/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:26:57.375055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975229-93f5-475b-b6e1-4f30e2ec6733 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:57.375637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975229-93f5-475b-b6e1-4f30e2ec6733 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:57.375735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975229-93f5-475b-b6e1-4f30e2ec6733 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:57.377119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 680/1374] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:26:57.383502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59a1c-5ed7-4893-a281-b5984ef18a3c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:57.384024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59a1c-5ed7-4893-a281-b5984ef18a3c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:57.384132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f59a1c-5ed7-4893-a281-b5984ef18a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:57.462852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-18f59a1c-5ed7-4893-a281-b5984ef18a3c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:26:57.464129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-18f59a1c-5ed7-4893-a281-b5984ef18a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:57.613654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 695/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:26:57.912471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab975229-93f5-475b-b6e1-4f30e2ec6733 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:26:57.914031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ab975229-93f5-475b-b6e1-4f30e2ec6733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:58.041836 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:58.083596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab975229-93f5-475b-b6e1-4f30e2ec6733 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:26:58.231267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca79a4-fbc3-4fcf-addb-1f1a6413d5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:26:58.231267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca79a4-fbc3-4fcf-addb-1f1a6413d5d1 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:26:58.231267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca79a4-fbc3-4fcf-addb-1f1a6413d5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:26:58.231267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca79a4-fbc3-4fcf-addb-1f1a6413d5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:26:58.232221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c4ca79a4-fbc3-4fcf-addb-1f1a6413d5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:26:58.317924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:26:58.334789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca79a4-fbc3-4fcf-addb-1f1a6413d5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:26:58.336407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca79a4-fbc3-4fcf-addb-1f1a6413d5d1 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:26:58.356433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 681/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:27:00.788888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38280-8b59-4cf1-af5a-c47c592147fd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:00.789449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38280-8b59-4cf1-af5a-c47c592147fd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:00.789449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38280-8b59-4cf1-af5a-c47c592147fd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:00.790939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 696/1377] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:00.796028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186241-670e-45be-a871-0507faba6fdb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:00.796444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186241-670e-45be-a871-0507faba6fdb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:00.796552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186241-670e-45be-a871-0507faba6fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:00.867526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-59186241-670e-45be-a871-0507faba6fdb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:00.868857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-59186241-670e-45be-a871-0507faba6fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:00.984458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 682/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:01.289386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38280-8b59-4cf1-af5a-c47c592147fd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:01.290912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-21e38280-8b59-4cf1-af5a-c47c592147fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:01.293936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:01.454690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38280-8b59-4cf1-af5a-c47c592147fd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:01.547147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:01.593125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b51323-4810-4abf-be07-f70f8b349d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:01.593726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b51323-4810-4abf-be07-f70f8b349d33 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:01.594032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b51323-4810-4abf-be07-f70f8b349d33 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:01.594356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b51323-4810-4abf-be07-f70f8b349d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:01.596641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a3b51323-4810-4abf-be07-f70f8b349d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:01.714466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b51323-4810-4abf-be07-f70f8b349d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:01.716472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b51323-4810-4abf-be07-f70f8b349d33 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:01.741273 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 697/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:04.319982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc69976-639a-4361-ac11-06b0549de286 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:04.320505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc69976-639a-4361-ac11-06b0549de286 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:04.320712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc69976-639a-4361-ac11-06b0549de286 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:04.322356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 683/1380] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:04.328184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e09e63-6ffa-41ea-8b1b-c8b0d011d31c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:04.328764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e09e63-6ffa-41ea-8b1b-c8b0d011d31c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:04.328914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e09e63-6ffa-41ea-8b1b-c8b0d011d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:04.402849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-85e09e63-6ffa-41ea-8b1b-c8b0d011d31c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:04.404080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-85e09e63-6ffa-41ea-8b1b-c8b0d011d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:04.450983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:04.514870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 698/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:04.804744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc69976-639a-4361-ac11-06b0549de286 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:04.806332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fbc69976-639a-4361-ac11-06b0549de286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:04.896628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:05.019821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc69976-639a-4361-ac11-06b0549de286 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:05.154928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d4002-bc3e-487c-9ea5-647bd9956f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:05.155567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4002-bc3e-487c-9ea5-647bd9956f2b service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:05.155845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4002-bc3e-487c-9ea5-647bd9956f2b service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:05.156108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4002-bc3e-487c-9ea5-647bd9956f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:05.157713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-446d4002-bc3e-487c-9ea5-647bd9956f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:05.179533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:05.307259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d4002-bc3e-487c-9ea5-647bd9956f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:05.307259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d4002-bc3e-487c-9ea5-647bd9956f2b service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:05.330728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 684/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:08.253061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0cb8e-1766-4a59-a377-5df363931a93 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:08.253719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0cb8e-1766-4a59-a377-5df363931a93 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:08.254118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0cb8e-1766-4a59-a377-5df363931a93 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:08.256747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 699/1383] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:08.262736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa520475-dbcc-432d-82aa-05884cd79093 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:08.263428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa520475-dbcc-432d-82aa-05884cd79093 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:08.263428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa520475-dbcc-432d-82aa-05884cd79093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:08.349168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fa520475-dbcc-432d-82aa-05884cd79093 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:08.350352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fa520475-dbcc-432d-82aa-05884cd79093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:08.624458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:08.634982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 685/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:08.941349 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0cb8e-1766-4a59-a377-5df363931a93 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:08.942902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-91a0cb8e-1766-4a59-a377-5df363931a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:09.112862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0cb8e-1766-4a59-a377-5df363931a93 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:09.136731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:09.239437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611c835-c1e1-41b9-9120-9470b978e173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:09.239967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611c835-c1e1-41b9-9120-9470b978e173 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:09.240335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611c835-c1e1-41b9-9120-9470b978e173 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:09.240601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611c835-c1e1-41b9-9120-9470b978e173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:09.242260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a611c835-c1e1-41b9-9120-9470b978e173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:09.353274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611c835-c1e1-41b9-9120-9470b978e173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:09.354919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611c835-c1e1-41b9-9120-9470b978e173 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:09.378547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 700/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:11.440148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840d03-393d-4f32-8041-edb245812eb2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:11.440732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840d03-393d-4f32-8041-edb245812eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:11.440732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840d03-393d-4f32-8041-edb245812eb2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:11.442083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 686/1386] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:11.447715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ebb90-810e-4b90-9676-cb5cd10864bd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:11.448197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ebb90-810e-4b90-9676-cb5cd10864bd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:11.448316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ebb90-810e-4b90-9676-cb5cd10864bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:11.487030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:11.525952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-008ebb90-810e-4b90-9676-cb5cd10864bd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:11.527372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-008ebb90-810e-4b90-9676-cb5cd10864bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:11.631650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85693-06a3-437f-96a0-9b4a023b3892 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:11.631993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85693-06a3-437f-96a0-9b4a023b3892 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:11.632422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85693-06a3-437f-96a0-9b4a023b3892 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:11.633960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 687/1387] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:27:11.640641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d09b4-9eb4-4fde-8f93-388435fe89fa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:11.640918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d09b4-9eb4-4fde-8f93-388435fe89fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:11.641188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d09b4-9eb4-4fde-8f93-388435fe89fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:11.647867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 701/1388] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:11.718048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-448d09b4-9eb4-4fde-8f93-388435fe89fa None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:11.722614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-448d09b4-9eb4-4fde-8f93-388435fe89fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:11.825041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 688/1389] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:27:11.950923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe9fb4-981f-4a31-9f03-f865ea839712 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:11.951172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe9fb4-981f-4a31-9f03-f865ea839712 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:11.951481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe9fb4-981f-4a31-9f03-f865ea839712 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:11.952831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 702/1390] 10.222.0.49 () {54 vars in 962 bytes} [Mon Sep 26 12:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:11.959189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc0db-77b7-46dd-b8d9-e92984ceae51 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:11.959505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc0db-77b7-46dd-b8d9-e92984ceae51 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:11.959787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc0db-77b7-46dd-b8d9-e92984ceae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:12.041356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-210bc0db-77b7-46dd-b8d9-e92984ceae51 None None] MFA Rules not processed for user `957e46599f5d4d21b822e8c9ce1480b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:12.042636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-210bc0db-77b7-46dd-b8d9-e92984ceae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:12.067431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:12.122380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe9fb4-981f-4a31-9f03-f865ea839712 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:12.124109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-85fe9fb4-981f-4a31-9f03-f865ea839712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:12.135251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 689/1391] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Sep 26 12:27:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:27:12.146132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc0db-77b7-46dd-b8d9-e92984ceae51 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:12.154263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc0db-77b7-46dd-b8d9-e92984ceae51 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:12.234812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:12.238600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b653d97-0442-4fb4-a7d0-3d38fe2178fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:12.239520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b653d97-0442-4fb4-a7d0-3d38fe2178fd service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:12.239520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b653d97-0442-4fb4-a7d0-3d38fe2178fd service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:12.239766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b653d97-0442-4fb4-a7d0-3d38fe2178fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:12.241428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2b653d97-0442-4fb4-a7d0-3d38fe2178fd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:12.288934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe9fb4-981f-4a31-9f03-f865ea839712 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:12.333084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:12.363114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b653d97-0442-4fb4-a7d0-3d38fe2178fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:12.363114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b653d97-0442-4fb4-a7d0-3d38fe2178fd service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:12.383942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 690/1392] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:27:12.435757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea092780-68d9-4980-b744-7761cbdd0bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:12.436671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092780-68d9-4980-b744-7761cbdd0bc2 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:12.436949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092780-68d9-4980-b744-7761cbdd0bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:12.437223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea092780-68d9-4980-b744-7761cbdd0bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:12.438842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ea092780-68d9-4980-b744-7761cbdd0bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:12.509937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:12.531094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea092780-68d9-4980-b744-7761cbdd0bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:12.532735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea092780-68d9-4980-b744-7761cbdd0bc2 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:12.553005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 703/1393] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:27:13.320676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244c44-82cc-44c0-b92b-30fd1b804243 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:13.325961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244c44-82cc-44c0-b92b-30fd1b804243 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:13.325961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f244c44-82cc-44c0-b92b-30fd1b804243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:13.395087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3f244c44-82cc-44c0-b92b-30fd1b804243 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:13.396329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3f244c44-82cc-44c0-b92b-30fd1b804243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:13.485883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 691/1394] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:13.530466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec99b-8dc7-4ed9-90d2-0f9dea2b95f4 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:13.530980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec99b-8dc7-4ed9-90d2-0f9dea2b95f4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:13.531082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec99b-8dc7-4ed9-90d2-0f9dea2b95f4 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:13.532434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 704/1395] 10.222.0.49 () {54 vars in 943 bytes} [Mon Sep 26 12:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:13.539076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135c02-feba-4217-8d73-b5dc17a57e01 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:13.539436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135c02-feba-4217-8d73-b5dc17a57e01 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:13.539720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8135c02-feba-4217-8d73-b5dc17a57e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:13.624823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:13.629523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b8135c02-feba-4217-8d73-b5dc17a57e01 None None] MFA Rules not processed for user `b99893144ac74cc9aec6d197c3dc1bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:13.632315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b8135c02-feba-4217-8d73-b5dc17a57e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:13.746160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 692/1396] 10.222.0.49 () {58 vars in 1040 bytes} [Mon Sep 26 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:13.755751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec99b-8dc7-4ed9-90d2-0f9dea2b95f4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:13.757255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2ebec99b-8dc7-4ed9-90d2-0f9dea2b95f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:13.897790 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec99b-8dc7-4ed9-90d2-0f9dea2b95f4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:13.955866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:14.008637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09192bae-0228-4132-af48-0aee36c4ef82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:14.009289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09192bae-0228-4132-af48-0aee36c4ef82 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:14.009571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09192bae-0228-4132-af48-0aee36c4ef82 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:14.009843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09192bae-0228-4132-af48-0aee36c4ef82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:14.011847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-09192bae-0228-4132-af48-0aee36c4ef82 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:14.098761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09192bae-0228-4132-af48-0aee36c4ef82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:14.100410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09192bae-0228-4132-af48-0aee36c4ef82 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:14.108617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 705/1397] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:27:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:27:14.954125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe541b2-7507-4adb-a6fe-7d2ec183ee1b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:14.954637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe541b2-7507-4adb-a6fe-7d2ec183ee1b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:14.954637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe541b2-7507-4adb-a6fe-7d2ec183ee1b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:14.956495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 693/1398] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:14.962189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c53e-3bd5-4a2a-bf28-0dd7f7f1e594 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:14.962698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c53e-3bd5-4a2a-bf28-0dd7f7f1e594 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:14.962798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c53e-3bd5-4a2a-bf28-0dd7f7f1e594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:15.040568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-11d5c53e-3bd5-4a2a-bf28-0dd7f7f1e594 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:15.041806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-11d5c53e-3bd5-4a2a-bf28-0dd7f7f1e594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:15.097140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:15.162096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 706/1399] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:15.464308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe541b2-7507-4adb-a6fe-7d2ec183ee1b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:15.465894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fbe541b2-7507-4adb-a6fe-7d2ec183ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:15.595822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:15.644219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe541b2-7507-4adb-a6fe-7d2ec183ee1b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:15.808615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a944c-be71-4cfb-9944-6aeaab73c5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:15.810265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a944c-be71-4cfb-9944-6aeaab73c5cd service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:15.810543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a944c-be71-4cfb-9944-6aeaab73c5cd service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:15.810814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a944c-be71-4cfb-9944-6aeaab73c5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:15.816396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d37a944c-be71-4cfb-9944-6aeaab73c5cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:15.910558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:15.926237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a944c-be71-4cfb-9944-6aeaab73c5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:15.928151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a944c-be71-4cfb-9944-6aeaab73c5cd service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:15.952943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 694/1400] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:18.953612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898206-3820-43ea-bee6-dbc9a8131ec3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:18.954177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898206-3820-43ea-bee6-dbc9a8131ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:18.954177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898206-3820-43ea-bee6-dbc9a8131ec3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:18.959396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 707/1401] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:18.961327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b2b4-26dd-47d0-a9b9-e690a51ada02 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:18.961797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b2b4-26dd-47d0-a9b9-e690a51ada02 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:18.961902 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5b2b4-26dd-47d0-a9b9-e690a51ada02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:19.039249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-52c5b2b4-26dd-47d0-a9b9-e690a51ada02 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:19.040703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-52c5b2b4-26dd-47d0-a9b9-e690a51ada02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:19.160390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 695/1402] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:19.462469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac898206-3820-43ea-bee6-dbc9a8131ec3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:19.464120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ac898206-3820-43ea-bee6-dbc9a8131ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:19.639981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac898206-3820-43ea-bee6-dbc9a8131ec3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:19.671909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:19.797671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d7c3d-d861-481c-a466-88e0645e960f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:19.798921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7c3d-d861-481c-a466-88e0645e960f service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:19.799781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7c3d-d861-481c-a466-88e0645e960f service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:19.799781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d7c3d-d861-481c-a466-88e0645e960f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:19.801491 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-835d7c3d-d861-481c-a466-88e0645e960f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:19.914034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d7c3d-d861-481c-a466-88e0645e960f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:19.915953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d7c3d-d861-481c-a466-88e0645e960f service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:19.940341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 708/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:22.396190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93031-dd08-4320-b02b-55ddd38bae72 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:22.396833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93031-dd08-4320-b02b-55ddd38bae72 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:22.396833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93031-dd08-4320-b02b-55ddd38bae72 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:22.398137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 696/1404] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:22.404170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cbee-9d05-4a20-b71d-c18dccb19f6b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:22.404712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cbee-9d05-4a20-b71d-c18dccb19f6b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:22.404712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cbee-9d05-4a20-b71d-c18dccb19f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:22.451762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:22.500956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3c72cbee-9d05-4a20-b71d-c18dccb19f6b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:22.506114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3c72cbee-9d05-4a20-b71d-c18dccb19f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:22.649035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 709/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:23.186864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93031-dd08-4320-b02b-55ddd38bae72 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:23.188800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6de93031-dd08-4320-b02b-55ddd38bae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:23.264684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:23.367954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93031-dd08-4320-b02b-55ddd38bae72 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:23.515864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7f2c7-e226-41f1-a964-db98e59a8614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:23.516591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7f2c7-e226-41f1-a964-db98e59a8614 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:23.516771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7f2c7-e226-41f1-a964-db98e59a8614 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:23.517527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7f2c7-e226-41f1-a964-db98e59a8614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:23.519354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8ce7f2c7-e226-41f1-a964-db98e59a8614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:23.539005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:23.634090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7f2c7-e226-41f1-a964-db98e59a8614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:23.635916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7f2c7-e226-41f1-a964-db98e59a8614 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:23.662224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 697/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:26.088210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710dc0d-d37c-42ee-a77c-1b10def56bd5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:26.088210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710dc0d-d37c-42ee-a77c-1b10def56bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:26.088210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710dc0d-d37c-42ee-a77c-1b10def56bd5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:26.088989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 710/1407] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:26.094507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac775e-6367-487d-9ab7-175d3064bddf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:26.095013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac775e-6367-487d-9ab7-175d3064bddf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:26.095776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac775e-6367-487d-9ab7-175d3064bddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:26.171288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-22ac775e-6367-487d-9ab7-175d3064bddf None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:26.173261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-22ac775e-6367-487d-9ab7-175d3064bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:26.279948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:26.293014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 698/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:26.584232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710dc0d-d37c-42ee-a77c-1b10def56bd5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:26.586917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2710dc0d-d37c-42ee-a77c-1b10def56bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:26.721682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:26.774557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710dc0d-d37c-42ee-a77c-1b10def56bd5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:26.918022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0bff-f3a4-4986-b5e8-4ca2ada220bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:26.918630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0bff-f3a4-4986-b5e8-4ca2ada220bf service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:26.918908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0bff-f3a4-4986-b5e8-4ca2ada220bf service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:26.919179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0bff-f3a4-4986-b5e8-4ca2ada220bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:26.920845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d11d0bff-f3a4-4986-b5e8-4ca2ada220bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:27.010103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:27.036090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0bff-f3a4-4986-b5e8-4ca2ada220bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:27.037705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0bff-f3a4-4986-b5e8-4ca2ada220bf service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:27.063264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 711/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:36.312265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:37.061033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=14 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:39.733862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f7da9-ba49-4759-8f62-15ec9dcc7e21 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:39.734410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f7da9-ba49-4759-8f62-15ec9dcc7e21 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:39.734410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f7da9-ba49-4759-8f62-15ec9dcc7e21 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:39.736961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 699/1410] 10.222.0.49 () {54 vars in 918 bytes} [Mon Sep 26 12:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:39.742746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d3880-62f9-4d70-95f3-ebdb85443909 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:39.743294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d3880-62f9-4d70-95f3-ebdb85443909 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:39.743294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d3880-62f9-4d70-95f3-ebdb85443909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:39.833867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d68d3880-62f9-4d70-95f3-ebdb85443909 None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:39.835113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d68d3880-62f9-4d70-95f3-ebdb85443909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:39.958612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 712/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Sep 26 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:39.974327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920371ba-f21a-4c97-92b7-4dfa15643059 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:39.974608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920371ba-f21a-4c97-92b7-4dfa15643059 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:39.974881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920371ba-f21a-4c97-92b7-4dfa15643059 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:39.976260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 700/1412] 10.222.0.49 () {54 vars in 918 bytes} [Mon Sep 26 12:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:39.981762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61add1-375f-4bd7-9697-329306215473 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:39.981762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61add1-375f-4bd7-9697-329306215473 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:39.982636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61add1-375f-4bd7-9697-329306215473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:40.071244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:40.074852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0f61add1-375f-4bd7-9697-329306215473 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:40.076107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0f61add1-375f-4bd7-9697-329306215473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:40.201249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 713/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Sep 26 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:27:42.881882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5568-6414-423e-982a-f889336f5538 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:42.882636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5568-6414-423e-982a-f889336f5538 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:42.882814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5568-6414-423e-982a-f889336f5538 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:42.884600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:42.890308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e6dec-1add-4573-9850-9fbf7b5451b9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:42.890759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e6dec-1add-4573-9850-9fbf7b5451b9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:42.890856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e6dec-1add-4573-9850-9fbf7b5451b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:42.960666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b33e6dec-1add-4573-9850-9fbf7b5451b9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:42.961775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b33e6dec-1add-4573-9850-9fbf7b5451b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:43.018117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:43.060064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:43.355602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd5568-6414-423e-982a-f889336f5538 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:43.357112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f3cd5568-6414-423e-982a-f889336f5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:43.507786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd5568-6414-423e-982a-f889336f5538 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:43.593408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:43.635890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a60381-2d19-44f4-8f3d-b204edb3fc51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:43.636764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60381-2d19-44f4-8f3d-b204edb3fc51 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:43.637044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60381-2d19-44f4-8f3d-b204edb3fc51 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:43.637319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a60381-2d19-44f4-8f3d-b204edb3fc51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:43.638928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-52a60381-2d19-44f4-8f3d-b204edb3fc51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:43.729065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a60381-2d19-44f4-8f3d-b204edb3fc51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:43.730681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a60381-2d19-44f4-8f3d-b204edb3fc51 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:43.755534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 702/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:44.939161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca701-34eb-439a-998d-69b172053f82 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:44.939765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca701-34eb-439a-998d-69b172053f82 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:44.939765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca701-34eb-439a-998d-69b172053f82 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:44.941097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:44.947558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8683575-ca7e-4abb-9ffa-fc2ad3be4220 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:44.948005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8683575-ca7e-4abb-9ffa-fc2ad3be4220 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:44.948099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8683575-ca7e-4abb-9ffa-fc2ad3be4220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:45.025999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f8683575-ca7e-4abb-9ffa-fc2ad3be4220 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:45.027167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f8683575-ca7e-4abb-9ffa-fc2ad3be4220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:45.055861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:45.128030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:45.284724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca701-34eb-439a-998d-69b172053f82 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:45.286160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7d6ca701-34eb-439a-998d-69b172053f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:45.435529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca701-34eb-439a-998d-69b172053f82 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:45.477446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:45.550538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7de8b8-0cd1-42d6-a5b9-6dcafb151fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:45.551055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7de8b8-0cd1-42d6-a5b9-6dcafb151fb8 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:45.551331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7de8b8-0cd1-42d6-a5b9-6dcafb151fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:45.551629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7de8b8-0cd1-42d6-a5b9-6dcafb151fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:45.553226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1d7de8b8-0cd1-42d6-a5b9-6dcafb151fb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:45.643827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7de8b8-0cd1-42d6-a5b9-6dcafb151fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:45.645556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7de8b8-0cd1-42d6-a5b9-6dcafb151fb8 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:45.663977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 716/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:46.832563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddd58c-2f16-4ee2-8234-35e0a74687b9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:46.833163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddd58c-2f16-4ee2-8234-35e0a74687b9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:46.833163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddd58c-2f16-4ee2-8234-35e0a74687b9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:46.834455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:46.840871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97dfce-e4b0-49b3-9115-d19451df5772 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:46.841305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97dfce-e4b0-49b3-9115-d19451df5772 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:46.841398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97dfce-e4b0-49b3-9115-d19451df5772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:46.899055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:46.921656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0b97dfce-e4b0-49b3-9115-d19451df5772 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:46.922950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0b97dfce-e4b0-49b3-9115-d19451df5772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:47.024180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:47.178553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddd58c-2f16-4ee2-8234-35e0a74687b9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:47.180121 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-36ddd58c-2f16-4ee2-8234-35e0a74687b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:47.328482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddd58c-2f16-4ee2-8234-35e0a74687b9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:47.341164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:47.445214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f68b62-88c0-4895-a278-dd0dc0e71530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:47.445812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68b62-88c0-4895-a278-dd0dc0e71530 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:47.446095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68b62-88c0-4895-a278-dd0dc0e71530 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:47.446356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f68b62-88c0-4895-a278-dd0dc0e71530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:47.447958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f6f68b62-88c0-4895-a278-dd0dc0e71530 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:47.538398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f68b62-88c0-4895-a278-dd0dc0e71530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:47.540005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f68b62-88c0-4895-a278-dd0dc0e71530 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:47.558640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 705/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:48.706588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081a3c-9acc-46ce-9bb5-4a833c52191c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:48.707184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081a3c-9acc-46ce-9bb5-4a833c52191c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:48.707184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2081a3c-9acc-46ce-9bb5-4a833c52191c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:48.708530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:48.715153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aa907-2bd0-4970-9ba3-d91add51dac0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:48.715752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aa907-2bd0-4970-9ba3-d91add51dac0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:48.715752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104aa907-2bd0-4970-9ba3-d91add51dac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:48.736566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:48.799366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-104aa907-2bd0-4970-9ba3-d91add51dac0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:48.800632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-104aa907-2bd0-4970-9ba3-d91add51dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:48.908019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:49.060870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2081a3c-9acc-46ce-9bb5-4a833c52191c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:49.062289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e2081a3c-9acc-46ce-9bb5-4a833c52191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:49.177244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:49.213791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2081a3c-9acc-46ce-9bb5-4a833c52191c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:49.332084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2dfe3f-5125-4e79-be30-a07fd0d1ad7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:49.332602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dfe3f-5125-4e79-be30-a07fd0d1ad7b service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:49.332884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dfe3f-5125-4e79-be30-a07fd0d1ad7b service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:49.333157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2dfe3f-5125-4e79-be30-a07fd0d1ad7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:49.334763 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b2dfe3f-5125-4e79-be30-a07fd0d1ad7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:49.415413 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:49.430031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dfe3f-5125-4e79-be30-a07fd0d1ad7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:49.431712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2dfe3f-5125-4e79-be30-a07fd0d1ad7b service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:49.450898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 719/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:50.607290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45dee6-131c-49b0-8afe-37eb38a2dd48 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:50.607955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45dee6-131c-49b0-8afe-37eb38a2dd48 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:50.607955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45dee6-131c-49b0-8afe-37eb38a2dd48 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:50.609302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:50.617140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28814b-f7f1-48e6-bf99-cbaf00034208 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:50.617717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28814b-f7f1-48e6-bf99-cbaf00034208 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:50.617717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28814b-f7f1-48e6-bf99-cbaf00034208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:50.697177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2a28814b-f7f1-48e6-bf99-cbaf00034208 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:50.698418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2a28814b-f7f1-48e6-bf99-cbaf00034208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:50.795461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:50.954370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45dee6-131c-49b0-8afe-37eb38a2dd48 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:50.958992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6b45dee6-131c-49b0-8afe-37eb38a2dd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:51.043561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:51.109069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45dee6-131c-49b0-8afe-37eb38a2dd48 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:51.231234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096954b0-6893-47b2-95ed-011834a3a09b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:51.231795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096954b0-6893-47b2-95ed-011834a3a09b service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:51.232076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096954b0-6893-47b2-95ed-011834a3a09b service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:51.232426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096954b0-6893-47b2-95ed-011834a3a09b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:51.233952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-096954b0-6893-47b2-95ed-011834a3a09b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:51.294999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:51.337210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096954b0-6893-47b2-95ed-011834a3a09b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:51.338826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096954b0-6893-47b2-95ed-011834a3a09b service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:51.357948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 708/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:27:52.504494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea59bd8-c69d-4f79-8cd6-0507ec2bb4fe None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:52.505086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea59bd8-c69d-4f79-8cd6-0507ec2bb4fe None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:52.505086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea59bd8-c69d-4f79-8cd6-0507ec2bb4fe None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:52.506428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:52.513539 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf3a5-7068-4069-8082-43c50dd247ac None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:52.513998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf3a5-7068-4069-8082-43c50dd247ac None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:52.514162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6cf3a5-7068-4069-8082-43c50dd247ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:52.594829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9a6cf3a5-7068-4069-8082-43c50dd247ac None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:52.596086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a6cf3a5-7068-4069-8082-43c50dd247ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:52.693596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:52.849568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea59bd8-c69d-4f79-8cd6-0507ec2bb4fe None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:52.850721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5ea59bd8-c69d-4f79-8cd6-0507ec2bb4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:52.910953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:53.017375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea59bd8-c69d-4f79-8cd6-0507ec2bb4fe None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:53.140633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a3692-a798-43e4-8658-2e75c9aec996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:53.141299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3692-a798-43e4-8658-2e75c9aec996 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:53.141805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3692-a798-43e4-8658-2e75c9aec996 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:53.142111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a3692-a798-43e4-8658-2e75c9aec996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:53.143769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6d1a3692-a798-43e4-8658-2e75c9aec996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:53.151026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:53.358508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a3692-a798-43e4-8658-2e75c9aec996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:53.360189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a3692-a798-43e4-8658-2e75c9aec996 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:53.378412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 722/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:54.548322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3871-4719-4acb-8c07-4f019c7dad0b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:54.549281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3871-4719-4acb-8c07-4f019c7dad0b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:54.549281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b3871-4719-4acb-8c07-4f019c7dad0b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:54.550954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:54.557644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d848b44-a2c4-49b8-acd8-6e11cfdd2132 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:54.558127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d848b44-a2c4-49b8-acd8-6e11cfdd2132 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:54.558230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d848b44-a2c4-49b8-acd8-6e11cfdd2132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:54.636936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6d848b44-a2c4-49b8-acd8-6e11cfdd2132 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:54.638142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6d848b44-a2c4-49b8-acd8-6e11cfdd2132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:54.705299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:54.734601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:54.887435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3871-4719-4acb-8c07-4f019c7dad0b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:54.889098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e88b3871-4719-4acb-8c07-4f019c7dad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:54.907463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:55.042037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b3871-4719-4acb-8c07-4f019c7dad0b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:55.141375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:55.169290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed0f2f-5097-4fc4-b12d-a1408626ebe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:55.169900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed0f2f-5097-4fc4-b12d-a1408626ebe3 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:55.170178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed0f2f-5097-4fc4-b12d-a1408626ebe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:55.170448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed0f2f-5097-4fc4-b12d-a1408626ebe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:55.173204 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1aed0f2f-5097-4fc4-b12d-a1408626ebe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:55.269131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed0f2f-5097-4fc4-b12d-a1408626ebe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:55.270729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed0f2f-5097-4fc4-b12d-a1408626ebe3 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:55.289881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 711/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:27:56.440239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f483a71-63ac-462d-b8f4-b8abef8c07f5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:56.440820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f483a71-63ac-462d-b8f4-b8abef8c07f5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:56.440820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f483a71-63ac-462d-b8f4-b8abef8c07f5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:56.442116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:56.448782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f367249-2e0d-4af7-aad1-a3cc6c47d928 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:56.449258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f367249-2e0d-4af7-aad1-a3cc6c47d928 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:56.449353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f367249-2e0d-4af7-aad1-a3cc6c47d928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:56.530147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6f367249-2e0d-4af7-aad1-a3cc6c47d928 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:56.531433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6f367249-2e0d-4af7-aad1-a3cc6c47d928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:56.574816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:56.639918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:56.798904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f483a71-63ac-462d-b8f4-b8abef8c07f5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:56.800471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7f483a71-63ac-462d-b8f4-b8abef8c07f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:56.965804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f483a71-63ac-462d-b8f4-b8abef8c07f5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:57.026417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:57.091811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205e775-c8bf-4aaa-8324-40aecfdd056c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:57.092358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e775-c8bf-4aaa-8324-40aecfdd056c service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:57.092563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e775-c8bf-4aaa-8324-40aecfdd056c service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:57.092860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205e775-c8bf-4aaa-8324-40aecfdd056c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:57.094585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f205e775-c8bf-4aaa-8324-40aecfdd056c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:57.187453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205e775-c8bf-4aaa-8324-40aecfdd056c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:57.189700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205e775-c8bf-4aaa-8324-40aecfdd056c service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:57.208815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 725/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:27:58.343571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527a1a-7b77-4b9a-a2bd-4266665f5e18 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:58.344732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527a1a-7b77-4b9a-a2bd-4266665f5e18 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:58.344732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af527a1a-7b77-4b9a-a2bd-4266665f5e18 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:58.345987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:27:58.352303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95040-6d73-4328-82d8-ad95bc8a0f1f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:58.352768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95040-6d73-4328-82d8-ad95bc8a0f1f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:58.352886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95040-6d73-4328-82d8-ad95bc8a0f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:58.427386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e5c95040-6d73-4328-82d8-ad95bc8a0f1f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:27:58.428591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e5c95040-6d73-4328-82d8-ad95bc8a0f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:58.430612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:58.526609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:27:58.676936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af527a1a-7b77-4b9a-a2bd-4266665f5e18 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:27:58.678455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af527a1a-7b77-4b9a-a2bd-4266665f5e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:58.827467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af527a1a-7b77-4b9a-a2bd-4266665f5e18 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:27:58.856971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:27:58.946982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ab647-7131-4151-aeba-c0ab95c5737e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:27:58.947662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab647-7131-4151-aeba-c0ab95c5737e service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:27:58.947970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab647-7131-4151-aeba-c0ab95c5737e service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:27:58.948344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab647-7131-4151-aeba-c0ab95c5737e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:27:58.949911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b14ab647-7131-4151-aeba-c0ab95c5737e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:27:59.044348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ab647-7131-4151-aeba-c0ab95c5737e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:27:59.045950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ab647-7131-4151-aeba-c0ab95c5737e service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:27:59.067942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 714/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:27:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:01.160143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b58d-7ae3-454a-aa5d-174acc1a7d36 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:01.160773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b58d-7ae3-454a-aa5d-174acc1a7d36 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:01.160773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b58d-7ae3-454a-aa5d-174acc1a7d36 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:01.162022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:01.167615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db3e6-c7a3-4d6e-ac17-9a7eb72b0f18 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:01.168074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db3e6-c7a3-4d6e-ac17-9a7eb72b0f18 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:01.168174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db3e6-c7a3-4d6e-ac17-9a7eb72b0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:01.210577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:01.235673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bc5db3e6-c7a3-4d6e-ac17-9a7eb72b0f18 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:01.236874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bc5db3e6-c7a3-4d6e-ac17-9a7eb72b0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:01.333093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:01.620204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52b58d-7ae3-454a-aa5d-174acc1a7d36 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:01.621789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7c52b58d-7ae3-454a-aa5d-174acc1a7d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:01.725950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52b58d-7ae3-454a-aa5d-174acc1a7d36 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:01.759593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:01.802776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21a316-c5b6-4c64-b5ed-83a9bfa86af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:01.803420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21a316-c5b6-4c64-b5ed-83a9bfa86af2 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:01.803704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21a316-c5b6-4c64-b5ed-83a9bfa86af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:01.803974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21a316-c5b6-4c64-b5ed-83a9bfa86af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:01.805622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8e21a316-c5b6-4c64-b5ed-83a9bfa86af2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:01.917200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21a316-c5b6-4c64-b5ed-83a9bfa86af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:01.918536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21a316-c5b6-4c64-b5ed-83a9bfa86af2 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:01.936140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 728/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:04.281443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257ae86-734e-4ad3-a43d-6f8ecafa0076 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:04.282023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257ae86-734e-4ad3-a43d-6f8ecafa0076 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:04.282023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257ae86-734e-4ad3-a43d-6f8ecafa0076 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:04.283370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:04.289129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943f6dd-5ef4-4307-9071-3822fe6b4284 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:04.289653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943f6dd-5ef4-4307-9071-3822fe6b4284 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:04.289653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943f6dd-5ef4-4307-9071-3822fe6b4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:04.360967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3943f6dd-5ef4-4307-9071-3822fe6b4284 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:04.362300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3943f6dd-5ef4-4307-9071-3822fe6b4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:04.375269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:04.458631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:04.744091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257ae86-734e-4ad3-a43d-6f8ecafa0076 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:04.745632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4257ae86-734e-4ad3-a43d-6f8ecafa0076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:04.852123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257ae86-734e-4ad3-a43d-6f8ecafa0076 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:04.865168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:04.927031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5131e-a121-4a94-ae4d-42ae541191c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:04.927669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5131e-a121-4a94-ae4d-42ae541191c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:04.927950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5131e-a121-4a94-ae4d-42ae541191c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:04.928226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5131e-a121-4a94-ae4d-42ae541191c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:04.929849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-45f5131e-a121-4a94-ae4d-42ae541191c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:05.042955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5131e-a121-4a94-ae4d-42ae541191c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:05.044386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5131e-a121-4a94-ae4d-42ae541191c6 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:05.064088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 717/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:07.723673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9214f5-b74f-43d3-9317-dadac3104589 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:07.724389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9214f5-b74f-43d3-9317-dadac3104589 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:07.724389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9214f5-b74f-43d3-9317-dadac3104589 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:07.725661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:07.731556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1d5f-749d-4b9f-a83b-62223ce647c8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:07.737049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1d5f-749d-4b9f-a83b-62223ce647c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:07.737049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1d5f-749d-4b9f-a83b-62223ce647c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:07.790269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:07.819389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6f6f1d5f-749d-4b9f-a83b-62223ce647c8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:07.820564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6f6f1d5f-749d-4b9f-a83b-62223ce647c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:07.939592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:08.237730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9214f5-b74f-43d3-9317-dadac3104589 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:08.239435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-db9214f5-b74f-43d3-9317-dadac3104589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:08.348638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9214f5-b74f-43d3-9317-dadac3104589 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:08.389778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:08.424505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea70f-1b4f-42c2-8128-db4034b67e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:08.425119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea70f-1b4f-42c2-8128-db4034b67e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:08.425398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea70f-1b4f-42c2-8128-db4034b67e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:08.425668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea70f-1b4f-42c2-8128-db4034b67e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:08.428026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9f6ea70f-1b4f-42c2-8128-db4034b67e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:08.541817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ea70f-1b4f-42c2-8128-db4034b67e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:08.543254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ea70f-1b4f-42c2-8128-db4034b67e05 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:08.562191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 731/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:10.930106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc96a2-fa20-42d0-92ce-c15bd213ed1f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:10.930684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc96a2-fa20-42d0-92ce-c15bd213ed1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:10.930684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc96a2-fa20-42d0-92ce-c15bd213ed1f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:10.932057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:10.937932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df494f-6a6f-4cb2-bf5d-75faf3d0a6ec None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:10.938398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df494f-6a6f-4cb2-bf5d-75faf3d0a6ec None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:10.938515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df494f-6a6f-4cb2-bf5d-75faf3d0a6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:11.006085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-13df494f-6a6f-4cb2-bf5d-75faf3d0a6ec None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:11.007239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-13df494f-6a6f-4cb2-bf5d-75faf3d0a6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:11.029097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:11.109152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:11.398956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc96a2-fa20-42d0-92ce-c15bd213ed1f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:11.400538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-41cc96a2-fa20-42d0-92ce-c15bd213ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:11.511469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc96a2-fa20-42d0-92ce-c15bd213ed1f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:11.534292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:11.591650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f9f8-0749-4839-9fc8-9c98f8e964ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:11.592270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f9f8-0749-4839-9fc8-9c98f8e964ab service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:11.592550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f9f8-0749-4839-9fc8-9c98f8e964ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:11.592823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f9f8-0749-4839-9fc8-9c98f8e964ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:11.594507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6e86f9f8-0749-4839-9fc8-9c98f8e964ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:11.709793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f9f8-0749-4839-9fc8-9c98f8e964ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:11.711142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f9f8-0749-4839-9fc8-9c98f8e964ab service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:11.730389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 720/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:14.042777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e556ca-360f-4b64-aaa0-2f4d77e52c2a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:14.043407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e556ca-360f-4b64-aaa0-2f4d77e52c2a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:14.043407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e556ca-360f-4b64-aaa0-2f4d77e52c2a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:14.044741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:14.051201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25490-9a51-4dd4-9653-a682e54b0d5f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:14.051710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25490-9a51-4dd4-9653-a682e54b0d5f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:14.051834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c25490-9a51-4dd4-9653-a682e54b0d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:14.120764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:14.123690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b1c25490-9a51-4dd4-9653-a682e54b0d5f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:14.125044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b1c25490-9a51-4dd4-9653-a682e54b0d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:14.251426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:14.546870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e556ca-360f-4b64-aaa0-2f4d77e52c2a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:14.548465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e3e556ca-360f-4b64-aaa0-2f4d77e52c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:14.657314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e556ca-360f-4b64-aaa0-2f4d77e52c2a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:14.712540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:14.738590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1b0f1-b531-4c2f-898e-ce168e2d6e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:14.739204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b0f1-b531-4c2f-898e-ce168e2d6e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:14.739507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b0f1-b531-4c2f-898e-ce168e2d6e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:14.739775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1b0f1-b531-4c2f-898e-ce168e2d6e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:14.741445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d7a1b0f1-b531-4c2f-898e-ce168e2d6e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:14.855696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b0f1-b531-4c2f-898e-ce168e2d6e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:14.857033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1b0f1-b531-4c2f-898e-ce168e2d6e4c service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:14.882404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 734/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:17.178376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff26e15-90a9-4b93-a658-0f6213b830ac None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:17.178945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff26e15-90a9-4b93-a658-0f6213b830ac None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:17.178945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff26e15-90a9-4b93-a658-0f6213b830ac None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:17.180352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:17.185893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcdc80-4fd0-4b62-8892-c6e278226f35 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:17.186392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcdc80-4fd0-4b62-8892-c6e278226f35 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:17.186491 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcdc80-4fd0-4b62-8892-c6e278226f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:17.256378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c7fcdc80-4fd0-4b62-8892-c6e278226f35 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:17.257594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c7fcdc80-4fd0-4b62-8892-c6e278226f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:17.288131 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:17.357902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:17.652812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff26e15-90a9-4b93-a658-0f6213b830ac None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:17.654423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6ff26e15-90a9-4b93-a658-0f6213b830ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:17.787402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff26e15-90a9-4b93-a658-0f6213b830ac None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:17.829758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:17.884376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f406d9-9645-4060-b274-a0e02e4c0b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:17.885022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f406d9-9645-4060-b274-a0e02e4c0b5e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:17.885318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f406d9-9645-4060-b274-a0e02e4c0b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:17.885579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f406d9-9645-4060-b274-a0e02e4c0b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:17.887650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-81f406d9-9645-4060-b274-a0e02e4c0b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:18.003769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f406d9-9645-4060-b274-a0e02e4c0b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:18.005116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f406d9-9645-4060-b274-a0e02e4c0b5e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:18.024025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 723/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:20.306181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe8898-a3a5-447c-b1a2-82798da5df44 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:20.306740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe8898-a3a5-447c-b1a2-82798da5df44 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:20.306740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe8898-a3a5-447c-b1a2-82798da5df44 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:20.308104 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:20.313728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d3ff-6276-4b8d-9291-09a647dbb782 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:20.314165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d3ff-6276-4b8d-9291-09a647dbb782 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:20.314262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d3ff-6276-4b8d-9291-09a647dbb782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:20.384889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-48d0d3ff-6276-4b8d-9291-09a647dbb782 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:20.386392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-48d0d3ff-6276-4b8d-9291-09a647dbb782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:20.395430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:20.495913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:20.788748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe8898-a3a5-447c-b1a2-82798da5df44 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:20.790335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8afe8898-a3a5-447c-b1a2-82798da5df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:20.917956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe8898-a3a5-447c-b1a2-82798da5df44 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:20.980266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:21.004209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc11e5-5e77-4467-8637-15fff10ef6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:21.005241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc11e5-5e77-4467-8637-15fff10ef6bf service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:21.005742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc11e5-5e77-4467-8637-15fff10ef6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:21.006238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc11e5-5e77-4467-8637-15fff10ef6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:21.009295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1bdc11e5-5e77-4467-8637-15fff10ef6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:21.135043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc11e5-5e77-4467-8637-15fff10ef6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:21.136799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc11e5-5e77-4467-8637-15fff10ef6bf service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:21.159568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 737/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:23.560715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34bbc1-f206-4f01-b4b6-8c9cbff97b41 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:23.561367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34bbc1-f206-4f01-b4b6-8c9cbff97b41 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:23.561367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34bbc1-f206-4f01-b4b6-8c9cbff97b41 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:23.562696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:23.568675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5df08-6dec-4cc7-9db9-eca054a78194 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:23.569262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5df08-6dec-4cc7-9db9-eca054a78194 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:23.569262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5df08-6dec-4cc7-9db9-eca054a78194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:23.639497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a6d5df08-6dec-4cc7-9db9-eca054a78194 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:23.641493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a6d5df08-6dec-4cc7-9db9-eca054a78194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:23.685514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:23.748482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:24.045894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34bbc1-f206-4f01-b4b6-8c9cbff97b41 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:24.048270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9b34bbc1-f206-4f01-b4b6-8c9cbff97b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:24.182698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34bbc1-f206-4f01-b4b6-8c9cbff97b41 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:24.230015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:24.275368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94d993-c43f-4806-9780-7e2f656ed1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:24.275994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94d993-c43f-4806-9780-7e2f656ed1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:24.276271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94d993-c43f-4806-9780-7e2f656ed1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:24.276547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94d993-c43f-4806-9780-7e2f656ed1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:24.278202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d94d993-c43f-4806-9780-7e2f656ed1f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:24.396179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94d993-c43f-4806-9780-7e2f656ed1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:24.397584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94d993-c43f-4806-9780-7e2f656ed1f8 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:24.417042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 726/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:26.711646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda929-6c2a-4b40-b260-655c8550b61a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:26.712223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda929-6c2a-4b40-b260-655c8550b61a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:26.712223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda929-6c2a-4b40-b260-655c8550b61a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:26.713548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:26.720121 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47da0-9c2d-4d38-b982-ae12c725c3f9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:26.720661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47da0-9c2d-4d38-b982-ae12c725c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:26.720661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef47da0-9c2d-4d38-b982-ae12c725c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:26.795821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2ef47da0-9c2d-4d38-b982-ae12c725c3f9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:26.797232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ef47da0-9c2d-4d38-b982-ae12c725c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:26.818595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:26.907207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:27.193782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbda929-6c2a-4b40-b260-655c8550b61a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:27.195453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fbbda929-6c2a-4b40-b260-655c8550b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:27.306435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbda929-6c2a-4b40-b260-655c8550b61a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:27.373449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:27.381972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09084706-0b02-431b-a9b9-76c41eed5b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:27.385547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09084706-0b02-431b-a9b9-76c41eed5b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:27.385547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09084706-0b02-431b-a9b9-76c41eed5b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:27.385547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09084706-0b02-431b-a9b9-76c41eed5b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:27.387194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-09084706-0b02-431b-a9b9-76c41eed5b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:27.502447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09084706-0b02-431b-a9b9-76c41eed5b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:27.503918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09084706-0b02-431b-a9b9-76c41eed5b9f service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:27.522852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 740/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:28:29.769418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53af0a-dbda-44f5-b68e-eac182be2f73 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:29.770002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53af0a-dbda-44f5-b68e-eac182be2f73 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:29.770002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53af0a-dbda-44f5-b68e-eac182be2f73 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:29.771365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:29.777341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2b33-7067-4e2d-b245-20216825200e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:29.777847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2b33-7067-4e2d-b245-20216825200e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:29.777952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2b33-7067-4e2d-b245-20216825200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:29.852903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-633e2b33-7067-4e2d-b245-20216825200e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:29.854138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-633e2b33-7067-4e2d-b245-20216825200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:29.905195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:29.955794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:30.244214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53af0a-dbda-44f5-b68e-eac182be2f73 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:30.245759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3b53af0a-dbda-44f5-b68e-eac182be2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:30.360181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53af0a-dbda-44f5-b68e-eac182be2f73 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:30.411199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:30.438554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286a17d-3046-41e3-bef6-28dc264d3b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:30.439169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286a17d-3046-41e3-bef6-28dc264d3b1f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:30.439475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286a17d-3046-41e3-bef6-28dc264d3b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:30.439749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286a17d-3046-41e3-bef6-28dc264d3b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:30.441390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3286a17d-3046-41e3-bef6-28dc264d3b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:30.561559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286a17d-3046-41e3-bef6-28dc264d3b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:30.563300 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286a17d-3046-41e3-bef6-28dc264d3b1f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:30.583063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 729/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:39.954377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=22 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:40.580542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=66 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:51.864616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29e6e-606f-45d4-a1d9-d672fa643018 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:51.865203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29e6e-606f-45d4-a1d9-d672fa643018 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:51.865695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29e6e-606f-45d4-a1d9-d672fa643018 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:51.867396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 742/1471] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:51.873079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981642e0-69e0-4dc9-a2cb-88d64baa69e0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:51.874199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981642e0-69e0-4dc9-a2cb-88d64baa69e0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:51.874507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981642e0-69e0-4dc9-a2cb-88d64baa69e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:51.951723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-981642e0-69e0-4dc9-a2cb-88d64baa69e0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:51.953090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-981642e0-69e0-4dc9-a2cb-88d64baa69e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:52.062595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 730/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:28:52.380466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78441-cb1a-44a8-baee-16a006b9ea6e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:52.380775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78441-cb1a-44a8-baee-16a006b9ea6e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:52.381057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78441-cb1a-44a8-baee-16a006b9ea6e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:52.382406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 743/1473] 10.222.0.49 () {54 vars in 962 bytes} [Mon Sep 26 12:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:28:52.389095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f915-50a7-4cdc-b9d1-21555c3075ef None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:52.389451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f915-50a7-4cdc-b9d1-21555c3075ef None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:52.389726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f915-50a7-4cdc-b9d1-21555c3075ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:52.478201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3977f915-50a7-4cdc-b9d1-21555c3075ef None None] MFA Rules not processed for user `957e46599f5d4d21b822e8c9ce1480b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:52.479659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3977f915-50a7-4cdc-b9d1-21555c3075ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:52.505381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:52.578222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 731/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Sep 26 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:52.589134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b78441-cb1a-44a8-baee-16a006b9ea6e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:52.590668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-93b78441-cb1a-44a8-baee-16a006b9ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:52.707942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b78441-cb1a-44a8-baee-16a006b9ea6e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:52.801455 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205c46-9098-4e5a-93b1-4f7e3c768ba4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:52.802075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205c46-9098-4e5a-93b1-4f7e3c768ba4 service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:52.802352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205c46-9098-4e5a-93b1-4f7e3c768ba4 service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:52.802620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205c46-9098-4e5a-93b1-4f7e3c768ba4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:52.804323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fd205c46-9098-4e5a-93b1-4f7e3c768ba4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:52.865824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:52.926325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd205c46-9098-4e5a-93b1-4f7e3c768ba4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:52.927799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd205c46-9098-4e5a-93b1-4f7e3c768ba4 service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:52.946765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 744/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:28:55.301219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187743f7-28c5-41c6-9245-50d732ef00eb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:55.301833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187743f7-28c5-41c6-9245-50d732ef00eb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:55.301833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187743f7-28c5-41c6-9245-50d732ef00eb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:55.303251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 732/1476] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:55.309053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71abc-4014-433b-8346-6845ee550b12 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:55.309559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71abc-4014-433b-8346-6845ee550b12 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:55.309663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f71abc-4014-433b-8346-6845ee550b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:55.387498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-78f71abc-4014-433b-8346-6845ee550b12 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:55.388729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-78f71abc-4014-433b-8346-6845ee550b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:55.490044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 745/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:55.775216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187743f7-28c5-41c6-9245-50d732ef00eb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:55.776905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-187743f7-28c5-41c6-9245-50d732ef00eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:55.919335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187743f7-28c5-41c6-9245-50d732ef00eb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:55.973788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:56.021867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6311ebc-26e6-4057-a72c-1d73a8feb8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:56.022487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311ebc-26e6-4057-a72c-1d73a8feb8df admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:56.022767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311ebc-26e6-4057-a72c-1d73a8feb8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:56.023038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6311ebc-26e6-4057-a72c-1d73a8feb8df admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:56.023730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6311ebc-26e6-4057-a72c-1d73a8feb8df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:56.025659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-e6311ebc-26e6-4057-a72c-1d73a8feb8df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:28:56.025659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:28:56.025659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:28:56.026786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6311ebc-26e6-4057-a72c-1d73a8feb8df admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:56.050139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 733/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Sep 26 12:28:55 2022] GET /identity/v3/projects => generated 2553 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:28:58.368346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f7926-4eba-4ef9-9320-987063b4bb2a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:58.369014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f7926-4eba-4ef9-9320-987063b4bb2a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:58.369014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f7926-4eba-4ef9-9320-987063b4bb2a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:58.370295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 746/1479] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:28:58.376746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208586-705c-4c15-a233-aa8065ffeb4f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:58.377220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208586-705c-4c15-a233-aa8065ffeb4f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:58.377406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208586-705c-4c15-a233-aa8065ffeb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:58.451048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0d208586-705c-4c15-a233-aa8065ffeb4f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:28:58.452363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d208586-705c-4c15-a233-aa8065ffeb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:58.564340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 734/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:28:58.899726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f7926-4eba-4ef9-9320-987063b4bb2a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:28:58.901414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-100f7926-4eba-4ef9-9320-987063b4bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:58.912334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:59.085008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f7926-4eba-4ef9-9320-987063b4bb2a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:28:59.187663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:28:59.224997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cb77b-87aa-4d56-9fd7-ea7b0b838da8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:28:59.225603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb77b-87aa-4d56-9fd7-ea7b0b838da8 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:28:59.225880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb77b-87aa-4d56-9fd7-ea7b0b838da8 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:28:59.226145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cb77b-87aa-4d56-9fd7-ea7b0b838da8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:28:59.227838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-254cb77b-87aa-4d56-9fd7-ea7b0b838da8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:28:59.326289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cb77b-87aa-4d56-9fd7-ea7b0b838da8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:28:59.327921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cb77b-87aa-4d56-9fd7-ea7b0b838da8 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:28:59.349017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 747/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:29:01.846253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e765c4-0e4a-4f68-b86a-2107a67b8f27 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:01.846847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e765c4-0e4a-4f68-b86a-2107a67b8f27 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:01.846847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e765c4-0e4a-4f68-b86a-2107a67b8f27 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:01.848174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 735/1482] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:29:01.854396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257643b-fb4b-46b9-a3d3-30b3c05efcd6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:01.854937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257643b-fb4b-46b9-a3d3-30b3c05efcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:01.854937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257643b-fb4b-46b9-a3d3-30b3c05efcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:01.933424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e257643b-fb4b-46b9-a3d3-30b3c05efcd6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:29:01.934783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e257643b-fb4b-46b9-a3d3-30b3c05efcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:01.989065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:02.045558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 748/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:29:02.340513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e765c4-0e4a-4f68-b86a-2107a67b8f27 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:29:02.342092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-79e765c4-0e4a-4f68-b86a-2107a67b8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:02.371767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:02.468845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e765c4-0e4a-4f68-b86a-2107a67b8f27 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:29:02.554400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d2eaa-8b5e-4a9c-b89e-105c906b86ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:29:02.555041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2eaa-8b5e-4a9c-b89e-105c906b86ee service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:02.555425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2eaa-8b5e-4a9c-b89e-105c906b86ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:02.555702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d2eaa-8b5e-4a9c-b89e-105c906b86ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:02.557333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f87d2eaa-8b5e-4a9c-b89e-105c906b86ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:02.639548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:02.677449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2eaa-8b5e-4a9c-b89e-105c906b86ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:29:02.678909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d2eaa-8b5e-4a9c-b89e-105c906b86ee service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:29:02.698564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 736/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:29:05.116982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72be2b-35ec-4fe2-891c-84c411a5eecd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:05.117577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72be2b-35ec-4fe2-891c-84c411a5eecd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:05.117577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72be2b-35ec-4fe2-891c-84c411a5eecd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:05.118933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 749/1485] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:29:05.124411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61704f8-5116-4dae-88e0-f95850672b3e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:05.124855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61704f8-5116-4dae-88e0-f95850672b3e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:05.124980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61704f8-5116-4dae-88e0-f95850672b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:05.196292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c61704f8-5116-4dae-88e0-f95850672b3e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:29:05.197501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c61704f8-5116-4dae-88e0-f95850672b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:05.295746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 737/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:29:05.595111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72be2b-35ec-4fe2-891c-84c411a5eecd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:29:05.596700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dc72be2b-35ec-4fe2-891c-84c411a5eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:05.710145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72be2b-35ec-4fe2-891c-84c411a5eecd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:29:05.791865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:05.794057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860022-b4a2-428e-be73-e34120ca1ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:29:05.794809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860022-b4a2-428e-be73-e34120ca1ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:05.795190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860022-b4a2-428e-be73-e34120ca1ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:05.795638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860022-b4a2-428e-be73-e34120ca1ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:05.797486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f6860022-b4a2-428e-be73-e34120ca1ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:05.919230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860022-b4a2-428e-be73-e34120ca1ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:29:05.920723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860022-b4a2-428e-be73-e34120ca1ce7 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:29:05.941864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 750/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:29:08.285981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24ae8-9062-4960-927e-f221e1cbaa63 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:08.286545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24ae8-9062-4960-927e-f221e1cbaa63 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:08.286545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24ae8-9062-4960-927e-f221e1cbaa63 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:08.287886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 738/1488] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:29:08.293253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef8a9-fe53-4afd-8fa1-7c0a97fd0c06 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:08.293706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef8a9-fe53-4afd-8fa1-7c0a97fd0c06 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:08.293824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ef8a9-fe53-4afd-8fa1-7c0a97fd0c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:08.360747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-418ef8a9-fe53-4afd-8fa1-7c0a97fd0c06 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:29:08.361968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-418ef8a9-fe53-4afd-8fa1-7c0a97fd0c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:08.418025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:08.463376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 751/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:29:08.755240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b24ae8-9062-4960-927e-f221e1cbaa63 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:29:08.756816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-60b24ae8-9062-4960-927e-f221e1cbaa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:08.795509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:08.867494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b24ae8-9062-4960-927e-f221e1cbaa63 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:29:08.949271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402215-f782-4fd3-a548-236daf6bfe6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:29:08.949874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402215-f782-4fd3-a548-236daf6bfe6a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:08.950155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402215-f782-4fd3-a548-236daf6bfe6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:08.950428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402215-f782-4fd3-a548-236daf6bfe6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:08.952068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-18402215-f782-4fd3-a548-236daf6bfe6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:09.038611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:09.070380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18402215-f782-4fd3-a548-236daf6bfe6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:29:09.071868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18402215-f782-4fd3-a548-236daf6bfe6a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:29:09.091897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 739/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:29:11.744171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e5962-cac9-4e8d-9a85-e78432c103dc None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:11.744738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e5962-cac9-4e8d-9a85-e78432c103dc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:11.744738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e5962-cac9-4e8d-9a85-e78432c103dc None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:11.746183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 752/1491] 10.222.0.49 () {54 vars in 927 bytes} [Mon Sep 26 12:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:29:11.751424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d702a-2171-4ede-9c85-b929aee166b6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:11.751850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d702a-2171-4ede-9c85-b929aee166b6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:11.751960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d702a-2171-4ede-9c85-b929aee166b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:11.841535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-896d702a-2171-4ede-9c85-b929aee166b6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:29:11.842798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-896d702a-2171-4ede-9c85-b929aee166b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:11.944835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 740/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Mon Sep 26 12:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:29:12.241164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e5962-cac9-4e8d-9a85-e78432c103dc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:29:12.242729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4d9e5962-cac9-4e8d-9a85-e78432c103dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:12.352022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e5962-cac9-4e8d-9a85-e78432c103dc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:29:12.432845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a950c0-a787-4a3d-ba14-4d52570bb13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:29:12.433464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a950c0-a787-4a3d-ba14-4d52570bb13d service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:29:12.433740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a950c0-a787-4a3d-ba14-4d52570bb13d service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:29:12.434010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a950c0-a787-4a3d-ba14-4d52570bb13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:29:12.435747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c3a950c0-a787-4a3d-ba14-4d52570bb13d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:29:12.446212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:12.555660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a950c0-a787-4a3d-ba14-4d52570bb13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:29:12.557113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a950c0-a787-4a3d-ba14-4d52570bb13d service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:29:12.577052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 753/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:29:21.943144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=82 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:29:22.574629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=50 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:37.249172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:37.250094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:37.250094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:37.328718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:30:37.329859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:37.428300 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 741/1494] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:30:37.437265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5cba3-0bec-472e-8c11-5beef3bd58a8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:37.437764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5cba3-0bec-472e-8c11-5beef3bd58a8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:37.437870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5cba3-0bec-472e-8c11-5beef3bd58a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:37.514736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-57b5cba3-0bec-472e-8c11-5beef3bd58a8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:30:37.515977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-57b5cba3-0bec-472e-8c11-5beef3bd58a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:37.617816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 754/1495] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:30:37.622637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:37.624097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:37.635565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47bbe-2d48-41ed-9431-96ec773cd98b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:37.701929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:37.736750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:37.737394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:37.737675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:37.737946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:37.738617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:30:37.738947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:37.740027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:37.740027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:30:37.740027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:30:37.740917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:37.753327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 742/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:30:37.761987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5cba3-0bec-472e-8c11-5beef3bd58a8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:37.771396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5cba3-0bec-472e-8c11-5beef3bd58a8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:37.834303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:37.870343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:37.870892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:37.871189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:37.871491 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:37.872139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:37.874077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:37.874077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: warnings.warn(msg) Sep 26 12:30:37.874077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: Sep 26 12:30:37.875291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:38.000479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 755/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:30:37 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:30:38.004642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:38.006185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:38.041461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efb502-7d74-40de-abfd-06ef1f7ce8f3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:38.141876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:38.142400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:38.142687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:38.143004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:38.144079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:38.144709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:38.144709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:30:38.144709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:30:38.145921 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:38.267351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 743/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:30:38 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:30:38.271697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:38.273242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:38.340814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e3132-2eec-4c2b-8c74-3cfb31dc9b57 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:38.425607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:38.435642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:38.436242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:38.437114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:38.437114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:38.437464 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:38.438465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:38.438465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: warnings.warn(msg) Sep 26 12:30:38.438465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: Sep 26 12:30:38.439371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:38.454404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 756/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:30:38.458545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:38.460127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:38.472457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b26db2-aff3-4b1c-93a2-484952cded7b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:38.497998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:38.568388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b85a-b459-463f-a46e-853d07d2077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:38.569006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b85a-b459-463f-a46e-853d07d2077d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:38.569286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b85a-b459-463f-a46e-853d07d2077d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:38.569559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b85a-b459-463f-a46e-853d07d2077d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:38.570200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b85a-b459-463f-a46e-853d07d2077d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:38.571206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-be57b85a-b459-463f-a46e-853d07d2077d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:38.571206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:30:38.571206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:30:38.572140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b85a-b459-463f-a46e-853d07d2077d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:38.586618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 744/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:30:38.590826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:38.593105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:38.626733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9bb33-bab5-4c17-b367-88652c842806 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:38.724254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466be71-43d4-4694-a365-4df2469e9bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:38.724820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466be71-43d4-4694-a365-4df2469e9bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:38.725096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466be71-43d4-4694-a365-4df2469e9bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:38.725370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466be71-43d4-4694-a365-4df2469e9bb1 admin admin] PATH_INFO: `/v3/projects/3f8e97c27a964a1b868e550aa2f5e428/users/ac1e883735c04887b6c844e556d6c385/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:38.748559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466be71-43d4-4694-a365-4df2469e9bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8e97c27a964a1b868e550aa2f5e428, user_id=ac1e883735c04887b6c844e556d6c385, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:38.749579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-f466be71-43d4-4694-a365-4df2469e9bb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:38.749579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: warnings.warn(msg) Sep 26 12:30:38.749579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: Sep 26 12:30:38.751629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466be71-43d4-4694-a365-4df2469e9bb1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:38.844962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 757/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:30:38 2022] PUT /identity/v3/projects/3f8e97c27a964a1b868e550aa2f5e428/users/ac1e883735c04887b6c844e556d6c385/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:30:38.857114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722dc58-681d-45e6-b875-98bedbfd7379 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:38.857401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722dc58-681d-45e6-b875-98bedbfd7379 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:38.857724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722dc58-681d-45e6-b875-98bedbfd7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:38.916152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7722dc58-681d-45e6-b875-98bedbfd7379 None None] MFA Rules not processed for user `ac1e883735c04887b6c844e556d6c385`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:30:38.917408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7722dc58-681d-45e6-b875-98bedbfd7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:39.003992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 745/1502] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:30:39.018066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9a35c-ad1f-4c0e-99c3-2834e7e39fee None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:39.018346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9a35c-ad1f-4c0e-99c3-2834e7e39fee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:39.018614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9a35c-ad1f-4c0e-99c3-2834e7e39fee None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:39.019978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 758/1503] 10.222.0.49 () {54 vars in 963 bytes} [Mon Sep 26 12:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:30:39.024858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7106-f2eb-41ff-9d2d-b6685f7848c6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:39.025142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7106-f2eb-41ff-9d2d-b6685f7848c6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:39.025417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc7106-f2eb-41ff-9d2d-b6685f7848c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:39.059304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:39.115964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-17bc7106-f2eb-41ff-9d2d-b6685f7848c6 None None] MFA Rules not processed for user `91af8e7c2dcd41e480e1b1a086ba2688`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:30:39.117232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-17bc7106-f2eb-41ff-9d2d-b6685f7848c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:39.203922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 746/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Mon Sep 26 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:30:39.211907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9a35c-ad1f-4c0e-99c3-2834e7e39fee None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:39.213428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dbb9a35c-ad1f-4c0e-99c3-2834e7e39fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:39.264735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:39.323250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9a35c-ad1f-4c0e-99c3-2834e7e39fee None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:39.400113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:39.400719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:39.401076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:39.401268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:39.402861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:39.507282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:39.508752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:39.512673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:39.528100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 759/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:30:39.574390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e997ca5-2bef-4f0a-9ddc-4747d05d0617 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:39.574799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e997ca5-2bef-4f0a-9ddc-4747d05d0617 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:39.574936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e997ca5-2bef-4f0a-9ddc-4747d05d0617 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:39.576748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 747/1506] 10.222.0.49 () {52 vars in 830 bytes} [Mon Sep 26 12:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:30:39.580572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:39.581788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:39.681398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2513c-9072-4376-af70-0b5671b2fe31 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:39.779220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:39.779948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:39.780270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:39.780651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] PATH_INFO: `/v3/users/ac1e883735c04887b6c844e556d6c385` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:39.794117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1e883735c04887b6c844e556d6c385)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:39.795167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:39.795167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: warnings.warn(msg) Sep 26 12:30:39.795167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: Sep 26 12:30:39.796537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:39.807076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:40.041834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1e883735c04887b6c844e556d6c385'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:40.042194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1e883735c04887b6c844e556d6c385'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:40.057691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1e883735c04887b6c844e556d6c385'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:40.085303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1e883735c04887b6c844e556d6c385'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:40.167453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1e883735c04887b6c844e556d6c385'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:40.174495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 760/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:30:39 2022] DELETE /identity/v3/users/ac1e883735c04887b6c844e556d6c385 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:30:40.178945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:40.179216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:40.179546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:40.238788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:30:40.240066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:40.318685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:40.332201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 748/1508] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:30:40.349545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:40.350787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:40.457262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588969d2-763d-44de-944b-1cec1317a8d1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:40.511778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:40.531885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bc4e3-10b3-4ce4-a800-06b4731ac982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:40.532493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc4e3-10b3-4ce4-a800-06b4731ac982 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:40.532771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc4e3-10b3-4ce4-a800-06b4731ac982 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:40.533031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bc4e3-10b3-4ce4-a800-06b4731ac982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:40.534735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1c0bc4e3-10b3-4ce4-a800-06b4731ac982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:40.648149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bc4e3-10b3-4ce4-a800-06b4731ac982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:40.650804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bc4e3-10b3-4ce4-a800-06b4731ac982 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:40.673346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 761/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:30:41.141365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:30:41.143106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:30:41.158679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b425c2b-db7a-49db-a2e7-e2de7080617e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:30:41.269343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:30:41.270021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:30:41.270254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:30:41.270530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] PATH_INFO: `/v3/projects/3f8e97c27a964a1b868e550aa2f5e428` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:30:41.281826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8e97c27a964a1b868e550aa2f5e428)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:30:41.282866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:30:41.282866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:30:41.282866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:30:41.284133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:30:41.396112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8e97c27a964a1b868e550aa2f5e428', 'request_id': 'req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:41.482942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8e97c27a964a1b868e550aa2f5e428', 'request_id': 'req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:41.489848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8e97c27a964a1b868e550aa2f5e428', 'request_id': 'req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:41.521080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] The token cache is being invalidate because project 3f8e97c27a964a1b868e550aa2f5e428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:30:41.521363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:41.522016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a8e4e6ed-f7de-4df8-970c-0494ea2ab228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:30:41.523645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 749/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:30:41 2022] DELETE /identity/v3/projects/3f8e97c27a964a1b868e550aa2f5e428 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:30:50.676577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=62 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:30:51.518818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:32:15.619265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79096627-f70e-496c-80ee-620ca6d3def0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:15.619977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79096627-f70e-496c-80ee-620ca6d3def0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:15.619977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79096627-f70e-496c-80ee-620ca6d3def0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:15.621190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:15.626244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0f28-da18-492d-a68a-c150850feba3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:15.626681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0f28-da18-492d-a68a-c150850feba3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:15.626787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa0f28-da18-492d-a68a-c150850feba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:15.694408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-94aa0f28-da18-492d-a68a-c150850feba3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:15.695711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94aa0f28-da18-492d-a68a-c150850feba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:15.754722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:15.916990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79096627-f70e-496c-80ee-620ca6d3def0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:15.919215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-79096627-f70e-496c-80ee-620ca6d3def0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:16.040121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79096627-f70e-496c-80ee-620ca6d3def0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:16.045519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520aab7-3395-4f9e-8adc-f8bd221d3c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:16.046115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520aab7-3395-4f9e-8adc-f8bd221d3c5a service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:16.046392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520aab7-3395-4f9e-8adc-f8bd221d3c5a service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:16.046658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520aab7-3395-4f9e-8adc-f8bd221d3c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:16.054777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520aab7-3395-4f9e-8adc-f8bd221d3c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:16.056372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520aab7-3395-4f9e-8adc-f8bd221d3c5a service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:16.065793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 763/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:17.177627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86bd08-42c8-4e65-b371-9120a40bd4c5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:17.178163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86bd08-42c8-4e65-b371-9120a40bd4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:17.178264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86bd08-42c8-4e65-b371-9120a40bd4c5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:17.179656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:17.186191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88f4f6-8382-4819-a5dd-0b97ddeeed3b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:17.186676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88f4f6-8382-4819-a5dd-0b97ddeeed3b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:17.186786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88f4f6-8382-4819-a5dd-0b97ddeeed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:17.207073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0d88f4f6-8382-4819-a5dd-0b97ddeeed3b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:17.208497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0d88f4f6-8382-4819-a5dd-0b97ddeeed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:17.230561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:17.393832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86bd08-42c8-4e65-b371-9120a40bd4c5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:17.409068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86bd08-42c8-4e65-b371-9120a40bd4c5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:17.409857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1b67-8285-4998-a81c-b3e0ea91b1fb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:17.410273 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1b67-8285-4998-a81c-b3e0ea91b1fb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:17.410537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1b67-8285-4998-a81c-b3e0ea91b1fb None None] PATH_INFO: `/v3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:17.412489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 765/1516] 10.222.0.62 () {54 vars in 925 bytes} [Mon Sep 26 12:32:17 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:32:17.415538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c673f32-de71-4b9b-82db-96b5dbc6b1ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:17.416165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673f32-de71-4b9b-82db-96b5dbc6b1ef service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:17.416452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673f32-de71-4b9b-82db-96b5dbc6b1ef service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:17.416870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c673f32-de71-4b9b-82db-96b5dbc6b1ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:17.418725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414647-2f4f-44b5-b4cf-60f2f2548d69 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:17.419123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414647-2f4f-44b5-b4cf-60f2f2548d69 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:17.419426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414647-2f4f-44b5-b4cf-60f2f2548d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:17.425927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c673f32-de71-4b9b-82db-96b5dbc6b1ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:17.428456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c673f32-de71-4b9b-82db-96b5dbc6b1ef service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:17.438282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 752/1517] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:17.485771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-35414647-2f4f-44b5-b4cf-60f2f2548d69 None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:17.487086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-35414647-2f4f-44b5-b4cf-60f2f2548d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:17.548768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:32:17.572082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 766/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Sep 26 12:32:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:32:26.733608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e7d5-765d-4831-a969-983728b24f7c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:26.736810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e7d5-765d-4831-a969-983728b24f7c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:26.736810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e7d5-765d-4831-a969-983728b24f7c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:26.736810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 753/1519] 10.222.0.49 () {54 vars in 961 bytes} [Mon Sep 26 12:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:26.741106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b985d-3e46-46c4-8467-a4ceabde2106 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:26.741528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b985d-3e46-46c4-8467-a4ceabde2106 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:26.741636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b985d-3e46-46c4-8467-a4ceabde2106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:26.763211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-230b985d-3e46-46c4-8467-a4ceabde2106 None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:26.764445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-230b985d-3e46-46c4-8467-a4ceabde2106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:26.773296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 767/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Sep 26 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:26.780810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183e7d5-765d-4831-a969-983728b24f7c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:26.794560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183e7d5-765d-4831-a969-983728b24f7c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:26.800040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab377b4-2eb0-4944-89f6-250af6de117d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:26.800660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab377b4-2eb0-4944-89f6-250af6de117d service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:26.800938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab377b4-2eb0-4944-89f6-250af6de117d service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:26.801209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab377b4-2eb0-4944-89f6-250af6de117d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:26.810953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab377b4-2eb0-4944-89f6-250af6de117d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:26.812588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab377b4-2eb0-4944-89f6-250af6de117d service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:26.823091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 754/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:28.928622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198de24b-fe97-4541-a4f0-780dd14db8de None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:28.929138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198de24b-fe97-4541-a4f0-780dd14db8de None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:28.929138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198de24b-fe97-4541-a4f0-780dd14db8de None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:28.930511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:32:28.938555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a019561-bc21-4bd3-9883-967b0746905d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:28.939060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a019561-bc21-4bd3-9883-967b0746905d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:28.939157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a019561-bc21-4bd3-9883-967b0746905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:28.959842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2a019561-bc21-4bd3-9883-967b0746905d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:28.961045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2a019561-bc21-4bd3-9883-967b0746905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:28.968999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:29.125453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198de24b-fe97-4541-a4f0-780dd14db8de None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:29.140998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198de24b-fe97-4541-a4f0-780dd14db8de None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:29.146446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6a497-f938-4c07-8da2-a384419e0a13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:29.147135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a497-f938-4c07-8da2-a384419e0a13 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:29.147440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a497-f938-4c07-8da2-a384419e0a13 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:29.147712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a497-f938-4c07-8da2-a384419e0a13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:29.155923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6a497-f938-4c07-8da2-a384419e0a13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:29.157495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6a497-f938-4c07-8da2-a384419e0a13 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:29.167642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 769/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:30.273304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e23f8-ce4d-4091-abbf-81c93c00a6bb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:30.273908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e23f8-ce4d-4091-abbf-81c93c00a6bb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:30.273908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e23f8-ce4d-4091-abbf-81c93c00a6bb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:30.275236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 12:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:30.281685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fbe2b-cc0d-4a8b-8ecc-df37aa867fe8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:30.282172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fbe2b-cc0d-4a8b-8ecc-df37aa867fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:30.282274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fbe2b-cc0d-4a8b-8ecc-df37aa867fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:30.310408 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ea8fbe2b-cc0d-4a8b-8ecc-df37aa867fe8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:30.311745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ea8fbe2b-cc0d-4a8b-8ecc-df37aa867fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:30.320728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:30.477074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e23f8-ce4d-4091-abbf-81c93c00a6bb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:30.491395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e23f8-ce4d-4091-abbf-81c93c00a6bb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:30.496990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e860a69-ac40-4a25-951f-e178ce7bed93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:30.497581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e860a69-ac40-4a25-951f-e178ce7bed93 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:30.497879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e860a69-ac40-4a25-951f-e178ce7bed93 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:30.498151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e860a69-ac40-4a25-951f-e178ce7bed93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:30.506357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e860a69-ac40-4a25-951f-e178ce7bed93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:30.507974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e860a69-ac40-4a25-951f-e178ce7bed93 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:30.517598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 757/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:34.589408 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fedb36-0794-4181-9afc-5a1007d3b2cc None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:34.589954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fedb36-0794-4181-9afc-5a1007d3b2cc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:34.589954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fedb36-0794-4181-9afc-5a1007d3b2cc None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:34.591324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:34.596910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc8a6-b0bd-4ded-a7b8-45733f364902 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:34.597327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc8a6-b0bd-4ded-a7b8-45733f364902 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:34.597469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc8a6-b0bd-4ded-a7b8-45733f364902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:34.616884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-af1cc8a6-b0bd-4ded-a7b8-45733f364902 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:34.618076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af1cc8a6-b0bd-4ded-a7b8-45733f364902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:34.625807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:34.913861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fedb36-0794-4181-9afc-5a1007d3b2cc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:34.915614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-42fedb36-0794-4181-9afc-5a1007d3b2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:34.999602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fedb36-0794-4181-9afc-5a1007d3b2cc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:35.003540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87e5db-a7db-4d04-9b64-96ec4ce8ab2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:35.004165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e5db-a7db-4d04-9b64-96ec4ce8ab2e service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:35.004446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e5db-a7db-4d04-9b64-96ec4ce8ab2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:35.004721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87e5db-a7db-4d04-9b64-96ec4ce8ab2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:35.020118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87e5db-a7db-4d04-9b64-96ec4ce8ab2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:35.021830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87e5db-a7db-4d04-9b64-96ec4ce8ab2e service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:35.032739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 772/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:37.276398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b3e5-2013-482f-8b54-944167e4e4f2 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:37.277040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b3e5-2013-482f-8b54-944167e4e4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:37.277148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b3e5-2013-482f-8b54-944167e4e4f2 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:37.278569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:37.284953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137846ca-5418-47db-a0a8-0160b28c7f2a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:37.285523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137846ca-5418-47db-a0a8-0160b28c7f2a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:37.285523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137846ca-5418-47db-a0a8-0160b28c7f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:37.307059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-137846ca-5418-47db-a0a8-0160b28c7f2a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:37.308764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-137846ca-5418-47db-a0a8-0160b28c7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:37.317107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:32:37.611789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b3e5-2013-482f-8b54-944167e4e4f2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:37.623367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b3e5-2013-482f-8b54-944167e4e4f2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:37.631906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4e171-9e25-4931-82ac-39ef90ec1b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:37.632534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e171-9e25-4931-82ac-39ef90ec1b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:37.632812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e171-9e25-4931-82ac-39ef90ec1b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:37.633082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e171-9e25-4931-82ac-39ef90ec1b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:37.643245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4e171-9e25-4931-82ac-39ef90ec1b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:37.644732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4e171-9e25-4931-82ac-39ef90ec1b8b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:37.655941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 760/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:41.439426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293a6a1-88e6-434d-9d2d-28f01c373215 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:41.440042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293a6a1-88e6-434d-9d2d-28f01c373215 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:41.440042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293a6a1-88e6-434d-9d2d-28f01c373215 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:41.441509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:41.447791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645649-2652-4e58-b452-32affddc3489 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:41.448307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645649-2652-4e58-b452-32affddc3489 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:41.448426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a645649-2652-4e58-b452-32affddc3489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:41.467788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3a645649-2652-4e58-b452-32affddc3489 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:41.468982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3a645649-2652-4e58-b452-32affddc3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:41.478170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:41.788697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293a6a1-88e6-434d-9d2d-28f01c373215 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:41.790568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6293a6a1-88e6-434d-9d2d-28f01c373215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:41.873158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293a6a1-88e6-434d-9d2d-28f01c373215 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:41.876866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631c36-ce6a-42a6-b056-3afd18c658db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:41.877479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631c36-ce6a-42a6-b056-3afd18c658db service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:41.877756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631c36-ce6a-42a6-b056-3afd18c658db service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:41.878030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631c36-ce6a-42a6-b056-3afd18c658db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:41.889178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27631c36-ce6a-42a6-b056-3afd18c658db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:41.890628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27631c36-ce6a-42a6-b056-3afd18c658db service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:41.901393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 775/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:44.140210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe868-af0f-4d4a-b43e-5f3388108b09 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:44.140746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe868-af0f-4d4a-b43e-5f3388108b09 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:44.140746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbe868-af0f-4d4a-b43e-5f3388108b09 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:44.142098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 12:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:32:44.147618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578826-884a-45dd-86fb-8c7339bcab85 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:44.148094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578826-884a-45dd-86fb-8c7339bcab85 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:44.148304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6578826-884a-45dd-86fb-8c7339bcab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:44.172531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a6578826-884a-45dd-86fb-8c7339bcab85 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:32:44.173773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a6578826-884a-45dd-86fb-8c7339bcab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:44.182960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 12:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:32:44.505459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbe868-af0f-4d4a-b43e-5f3388108b09 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:32:44.507306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8ebbe868-af0f-4d4a-b43e-5f3388108b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:32:44.516858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=79 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:32:44.524256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbe868-af0f-4d4a-b43e-5f3388108b09 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:32:44.528000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6b785-afd9-4fcb-9cd3-b4c4db10cbe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:32:44.528616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b785-afd9-4fcb-9cd3-b4c4db10cbe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:32:44.528902 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b785-afd9-4fcb-9cd3-b4c4db10cbe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:32:44.529171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b785-afd9-4fcb-9cd3-b4c4db10cbe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:32:44.541734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6b785-afd9-4fcb-9cd3-b4c4db10cbe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:32:44.543191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6b785-afd9-4fcb-9cd3-b4c4db10cbe9 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:32:44.554449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 763/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:32:54.167604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:32:54.564512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:21.779651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b02b9-6369-4ae6-9bd5-3542d47317db None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:21.781335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b02b9-6369-4ae6-9bd5-3542d47317db None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:21.781335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b02b9-6369-4ae6-9bd5-3542d47317db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:21.808029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d04b02b9-6369-4ae6-9bd5-3542d47317db None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:21.809238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d04b02b9-6369-4ae6-9bd5-3542d47317db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:21.821376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 777/1540] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:21.830498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349ccb-e568-49c4-ba4c-13fe46d72d88 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:21.831069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349ccb-e568-49c4-ba4c-13fe46d72d88 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:21.831069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6349ccb-e568-49c4-ba4c-13fe46d72d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:21.859292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e6349ccb-e568-49c4-ba4c-13fe46d72d88 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:21.860308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e6349ccb-e568-49c4-ba4c-13fe46d72d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:21.874633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 764/1541] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:21.880474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b02b9-6369-4ae6-9bd5-3542d47317db None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:21.893226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b02b9-6369-4ae6-9bd5-3542d47317db None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:21.904313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:21.904940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:21.905218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:21.905490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:21.906147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:21.906987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:21.907503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:34:21.907503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: warnings.warn(msg) Sep 26 12:34:21.907503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: Sep 26 12:34:21.908405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd9b7-d4b4-450e-8d48-ccd70af73d96 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:21.928964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 778/1542] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:21.937892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349ccb-e568-49c4-ba4c-13fe46d72d88 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:21.954665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6349ccb-e568-49c4-ba4c-13fe46d72d88 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:21.964785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd97a5-2f84-4a9e-bce1-e79bd2c9047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:21.965418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd97a5-2f84-4a9e-bce1-e79bd2c9047e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:21.965714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd97a5-2f84-4a9e-bce1-e79bd2c9047e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:21.965980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd97a5-2f84-4a9e-bce1-e79bd2c9047e admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:21.966630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd97a5-2f84-4a9e-bce1-e79bd2c9047e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:21.967691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-00dd97a5-2f84-4a9e-bce1-e79bd2c9047e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:34:21.967691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:34:21.967691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:34:21.968880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd97a5-2f84-4a9e-bce1-e79bd2c9047e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.007658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c4c3b-7552-402b-8fa5-1145285ae997 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.007861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c4c3b-7552-402b-8fa5-1145285ae997 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.008147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c4c3b-7552-402b-8fa5-1145285ae997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.045088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c18c4c3b-7552-402b-8fa5-1145285ae997 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.047168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c18c4c3b-7552-402b-8fa5-1145285ae997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.062541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 779/1543] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:22.063633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3134-38d4-4b8e-a7b3-0e3d9557206a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.063993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3134-38d4-4b8e-a7b3-0e3d9557206a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.070153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc3134-38d4-4b8e-a7b3-0e3d9557206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.100117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5ffc3134-38d4-4b8e-a7b3-0e3d9557206a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.101336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5ffc3134-38d4-4b8e-a7b3-0e3d9557206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.117907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 780/1544] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.119540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b25a0-d25c-478d-92b6-bc54ed18efbc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.119828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b25a0-d25c-478d-92b6-bc54ed18efbc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.120102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b25a0-d25c-478d-92b6-bc54ed18efbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.147802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 765/1545] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:21 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:22.156166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c3b1-2f76-41c8-bdb0-42f87e417a26 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.156503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c3b1-2f76-41c8-bdb0-42f87e417a26 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.156745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c3b1-2f76-41c8-bdb0-42f87e417a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.170540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-760b25a0-d25c-478d-92b6-bc54ed18efbc None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.172329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-760b25a0-d25c-478d-92b6-bc54ed18efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.187282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e0b6c3b1-2f76-41c8-bdb0-42f87e417a26 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.188527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e0b6c3b1-2f76-41c8-bdb0-42f87e417a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.255547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 781/1546] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.258174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713acc5-904f-474f-a9cb-75ce94d9dc9a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.258174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713acc5-904f-474f-a9cb-75ce94d9dc9a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.260306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713acc5-904f-474f-a9cb-75ce94d9dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.263620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 766/1547] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.264860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6c3b1-2f76-41c8-bdb0-42f87e417a26 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.277130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6c3b1-2f76-41c8-bdb0-42f87e417a26 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.282156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064436ed-f87c-4f23-879f-3473a765f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.282810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064436ed-f87c-4f23-879f-3473a765f905 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.283199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064436ed-f87c-4f23-879f-3473a765f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.283723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064436ed-f87c-4f23-879f-3473a765f905 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.284699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064436ed-f87c-4f23-879f-3473a765f905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.285279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c713acc5-904f-474f-a9cb-75ce94d9dc9a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.286958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c713acc5-904f-474f-a9cb-75ce94d9dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.287087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064436ed-f87c-4f23-879f-3473a765f905 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.295935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 782/1548] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.298403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37314-a2a2-4059-b16b-6595a6ded2e5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.298943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37314-a2a2-4059-b16b-6595a6ded2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.300516 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37314-a2a2-4059-b16b-6595a6ded2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.324396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-57b37314-a2a2-4059-b16b-6595a6ded2e5 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.325726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-57b37314-a2a2-4059-b16b-6595a6ded2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.334898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 783/1549] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.336011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7c988-0874-4e63-8937-92c68c0b0789 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.336292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7c988-0874-4e63-8937-92c68c0b0789 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.336565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7c988-0874-4e63-8937-92c68c0b0789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.356747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-22d7c988-0874-4e63-8937-92c68c0b0789 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.357973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-22d7c988-0874-4e63-8937-92c68c0b0789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.365895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 784/1550] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.378636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ed5ab-5152-4169-b453-0122dd5f1e2a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.378636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ed5ab-5152-4169-b453-0122dd5f1e2a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.378636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ed5ab-5152-4169-b453-0122dd5f1e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.386899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cd6ed5ab-5152-4169-b453-0122dd5f1e2a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.388127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cd6ed5ab-5152-4169-b453-0122dd5f1e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.396775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 785/1551] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.397554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ed5ab-5152-4169-b453-0122dd5f1e2a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.406217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 767/1552] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:22.406950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ed5ab-5152-4169-b453-0122dd5f1e2a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.407526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7143-d0d4-4d2f-8261-db09561ef19d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.407910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7143-d0d4-4d2f-8261-db09561ef19d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.408193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b7143-d0d4-4d2f-8261-db09561ef19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.413755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9f44a-5c8f-48bd-8c82-d48e0ce38a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.418748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9f44a-5c8f-48bd-8c82-d48e0ce38a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.418748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9f44a-5c8f-48bd-8c82-d48e0ce38a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.418748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9f44a-5c8f-48bd-8c82-d48e0ce38a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.418748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9f44a-5c8f-48bd-8c82-d48e0ce38a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:22.418748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9f44a-5c8f-48bd-8c82-d48e0ce38a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.418748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9f44a-5c8f-48bd-8c82-d48e0ce38a11 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.428841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-350b7143-d0d4-4d2f-8261-db09561ef19d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.430132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-350b7143-d0d4-4d2f-8261-db09561ef19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.432231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 786/1553] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:22.433601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292625b7-65ca-4ee8-86ca-21af34f40ceb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.433895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292625b7-65ca-4ee8-86ca-21af34f40ceb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.434170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292625b7-65ca-4ee8-86ca-21af34f40ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.446713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 768/1554] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.447802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7143-d0d4-4d2f-8261-db09561ef19d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.455404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-292625b7-65ca-4ee8-86ca-21af34f40ceb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.457226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-292625b7-65ca-4ee8-86ca-21af34f40ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.458501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b7143-d0d4-4d2f-8261-db09561ef19d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.463491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bb616-8b08-4931-af74-6b70b194e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.464195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb616-8b08-4931-af74-6b70b194e3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.464477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb616-8b08-4931-af74-6b70b194e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.464750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb616-8b08-4931-af74-6b70b194e3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.465454 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bb616-8b08-4931-af74-6b70b194e3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:22.465575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 787/1555] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.465763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bb616-8b08-4931-af74-6b70b194e3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.466727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46d04-38e0-4eff-b4e6-6bde97d19b07 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.467011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46d04-38e0-4eff-b4e6-6bde97d19b07 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.467283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46d04-38e0-4eff-b4e6-6bde97d19b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.467490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2bb616-8b08-4931-af74-6b70b194e3a9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.481245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 769/1556] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:22.482572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e166ee-b429-486b-84fc-2cd6b9ff83be None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.482855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e166ee-b429-486b-84fc-2cd6b9ff83be None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.483152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e166ee-b429-486b-84fc-2cd6b9ff83be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.492206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-70f46d04-38e0-4eff-b4e6-6bde97d19b07 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.493413 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-70f46d04-38e0-4eff-b4e6-6bde97d19b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.502066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 788/1557] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.502792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46d04-38e0-4eff-b4e6-6bde97d19b07 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.506365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-62e166ee-b429-486b-84fc-2cd6b9ff83be None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.512982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-62e166ee-b429-486b-84fc-2cd6b9ff83be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.513614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46d04-38e0-4eff-b4e6-6bde97d19b07 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.517527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 770/1558] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.518445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.518604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e166ee-b429-486b-84fc-2cd6b9ff83be None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.519665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.519979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.520158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.520909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:22.521219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.522989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.532753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e166ee-b429-486b-84fc-2cd6b9ff83be None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.538217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.552174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.552174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.552174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.552174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.552174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.552674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 789/1559] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:22.552674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.553006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 771/1560] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:22.553877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.557967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f445f1-e0a3-43f9-b46b-bb2a379e0587 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.562605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742f44-e38a-4f15-844e-39f0ae417f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.563250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742f44-e38a-4f15-844e-39f0ae417f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.563631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742f44-e38a-4f15-844e-39f0ae417f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.563902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742f44-e38a-4f15-844e-39f0ae417f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.564535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742f44-e38a-4f15-844e-39f0ae417f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.564699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda14995-a961-4704-a1c3-1288352c65d0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.566980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742f44-e38a-4f15-844e-39f0ae417f8c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.571003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1aa69-bf59-495e-b3ec-f3c7cda5cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.571678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1aa69-bf59-495e-b3ec-f3c7cda5cfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.571972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1aa69-bf59-495e-b3ec-f3c7cda5cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.572245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1aa69-bf59-495e-b3ec-f3c7cda5cfc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.572895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1aa69-bf59-495e-b3ec-f3c7cda5cfc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:22.573197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1aa69-bf59-495e-b3ec-f3c7cda5cfc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.574918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1aa69-bf59-495e-b3ec-f3c7cda5cfc6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.590856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 772/1561] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:22.592177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11781bab-12b8-4dc4-a8b7-fa8a53b784c3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.592479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11781bab-12b8-4dc4-a8b7-fa8a53b784c3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.592774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11781bab-12b8-4dc4-a8b7-fa8a53b784c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.613820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-11781bab-12b8-4dc4-a8b7-fa8a53b784c3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.615044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-11781bab-12b8-4dc4-a8b7-fa8a53b784c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.623200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 773/1562] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.624823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11781bab-12b8-4dc4-a8b7-fa8a53b784c3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.636097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11781bab-12b8-4dc4-a8b7-fa8a53b784c3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.640868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.641461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.641740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.642012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.642637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.645543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.721472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 790/1563] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:22.721472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711680-ca84-4696-99e6-4cbf6411ad8b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.721472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711680-ca84-4696-99e6-4cbf6411ad8b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.721472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e711680-ca84-4696-99e6-4cbf6411ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.740943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5e711680-ca84-4696-99e6-4cbf6411ad8b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:22.742159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5e711680-ca84-4696-99e6-4cbf6411ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:22.750857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 774/1564] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:22.751737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.782991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:22.790027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:22.810898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 791/1565] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:22.811949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e711680-ca84-4696-99e6-4cbf6411ad8b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.822212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e711680-ca84-4696-99e6-4cbf6411ad8b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.827234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.832741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.832741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.832741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.832741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.833156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20335c8-7a6d-4b18-b195-9f9816b4a7aa admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.833642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.836971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.837750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.838067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.838338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.839200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:22.839484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.841122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.853738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 775/1566] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:22.854569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.864698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15f7a7-1384-46d9-992d-1b887b3855df admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.869691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.870283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.870566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.870838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.871515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.873225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.884427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 776/1567] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:22.885223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:22.895894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a306-1e5c-4868-8513-f536e995e6b1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:22.900663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:22.901255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:22.901536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:22.901808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:22.902434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:22.904414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:22.967434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 792/1568] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:22.967434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.026238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b98fb7-84f3-4937-9022-100b31b1fbe4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.031005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.031665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.031981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.032251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.032902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:23.033258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.034903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.046789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 793/1569] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:23.047679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.051491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 777/1570] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:22 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.051491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.064285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38a8d2-3eb8-4f94-9f9f-b3eca9b9cabe admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.123800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e12c8-bb47-45ed-999b-67dc92593400 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.129186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.129815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.130091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.130282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.130429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.130896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.131040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.131176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.131486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.132137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.132975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.133144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:34:23.133144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: warnings.warn(msg) Sep 26 12:34:23.133144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: Sep 26 12:34:23.134476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.282604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 778/1571] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.283636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.294082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc0acf-1352-4a36-bf2d-bb89a1291387 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.298784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.299418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.299559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 794/1572] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.299733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.299965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.301210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.301319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:23.301685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.303315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.311165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e31cc-5406-4b88-80f9-c95774811778 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.316337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.317119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.317402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.317732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.318359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.318659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 779/1573] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:23.319514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.320399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.329595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0fca2-3bcd-46de-9148-aadaad8601f2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.334465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.335137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.335444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.335720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] PATH_INFO: `/v3/projects/3f9686d8c3b74155a4427357a40dfdb2/users/e5496f0182f44d4d891959fe7422562c/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.351552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9686d8c3b74155a4427357a40dfdb2, user_id=e5496f0182f44d4d891959fe7422562c, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.352578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:34:23.352578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:34:23.352578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:34:23.354491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.441144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 795/1574] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.442173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.463488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:23.477185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 780/1575] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:23 2022] PUT /identity/v3/projects/3f9686d8c3b74155a4427357a40dfdb2/users/e5496f0182f44d4d891959fe7422562c/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:23.478006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.512594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fa96c-e2b3-40c9-bbfe-f3799a0a13ee admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.528918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:23.551404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c83ad-a167-42ea-ae49-a8c33848bb20 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.556537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.557225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.557570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.558058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.558940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.561267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.573660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.574555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.574831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.575095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.575765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.577695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.694489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 781/1576] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.695304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.704679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa4dba-566d-4281-b639-d5588eef55cd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.709864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.710450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.710724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.710988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.711642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.713530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.724423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 796/1577] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.725261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.734783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d8ce-cb2e-44c8-bb2a-b7412ecb853b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.739723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.740472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.740612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.740833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.741468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.743080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.754433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 797/1578] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:23.756065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.766825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176b0bf-9a29-4a25-a89f-ce50e9e93efa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.772109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.772716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.791904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.791904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.791904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.791904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.791904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 798/1579] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:23.791904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.800827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae939c-930d-4f97-b725-5ea966365223 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.806811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e07166-b5bf-4ec3-860c-ac87b96b9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:23.807831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e07166-b5bf-4ec3-860c-ac87b96b9e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.808345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e07166-b5bf-4ec3-860c-ac87b96b9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.808805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e07166-b5bf-4ec3-860c-ac87b96b9e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.809363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e07166-b5bf-4ec3-860c-ac87b96b9e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:23.811268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e07166-b5bf-4ec3-860c-ac87b96b9e2d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:23.894143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 782/1580] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.895090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:23.948706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 799/1581] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/projects => generated 405 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:23.950057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c34b-6aa2-498e-95b9-469bae23e3d4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:23.950406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c34b-6aa2-498e-95b9-469bae23e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:23.950776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213c34b-6aa2-498e-95b9-469bae23e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:23.957237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fa97e-a682-478f-bc9a-f49c3eb828a5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:23.970907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8213c34b-6aa2-498e-95b9-469bae23e3d4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:23.976557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8213c34b-6aa2-498e-95b9-469bae23e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:24.015764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.016346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.016629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.016902 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.017547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.020316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.035562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 800/1582] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:24.036412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213c34b-6aa2-498e-95b9-469bae23e3d4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.050851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213c34b-6aa2-498e-95b9-469bae23e3d4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.051874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.052783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.053067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.053339 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.054001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.055659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.067446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 801/1583] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.068232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.073568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:24.079208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058f2ab-5b23-44f6-9bd4-ba5b93d5d82c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.084588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.088241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.088241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.088241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.088241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.088241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.101724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 802/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.102593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.116256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807a188-8fb5-4218-97c8-2dc5c29193c6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.120952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.121553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.121832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.122106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.122747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.124371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.135970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 803/1585] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.136803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.147251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea67721-499e-41ef-b7ea-0f824652e9bb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.152301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.152890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.153199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.153497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.154122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.155741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.167066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 804/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.167917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.177734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e0947-27a7-4773-870f-2fd99e2f3e7e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.182322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.183261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.183569 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.183842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.184472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.186736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.200893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 783/1587] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:23 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:24.201852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.212464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fcbb3-2b8a-49fe-a9c4-3da16f854a33 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.217536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.218135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.218419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.218703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.219307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.221418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.354653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 805/1588] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:24 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:24.355601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.357175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:24.387326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 784/1589] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:24 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:24.388311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.399450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36572ded-6ce8-4b99-aeb4-99c5ded5f72b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.404166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.404768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.405052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.405324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.405957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.407610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.417601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ae191-ec53-4de2-99d4-d17848944984 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.418967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 785/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.419982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.425618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.426347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.426635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.426905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.430932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60070ee7-6de0-4456-bb40-497f05672a58 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.440326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.440490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.440684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.440684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.440684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.440913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.440997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.440997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.449449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 806/1591] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:24.450266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.461875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 786/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.461875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.462167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1ce3a-f685-4111-a898-27c349d822e9 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.462496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa1fe4-ab56-4696-a085-814ae864ebf1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.464411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:24.466810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.467801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.467801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.468018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.468113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] PATH_INFO: `/v3/projects/576ee35ecff64e7dadf3c174b0a6f348/users/707fc75182aa430ca16da14982d5733a/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.468608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.468892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.469174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] PATH_INFO: `/v3/projects/8e8d91b495a6465aa22a98350a2e83db/users/e669ba23bc374299b3728511aeff1fc2/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.485113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8d91b495a6465aa22a98350a2e83db, user_id=e669ba23bc374299b3728511aeff1fc2, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.485372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=576ee35ecff64e7dadf3c174b0a6f348, user_id=707fc75182aa430ca16da14982d5733a, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.488343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.488894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.615669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 787/1593] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:24 2022] PUT /identity/v3/projects/8e8d91b495a6465aa22a98350a2e83db/users/e669ba23bc374299b3728511aeff1fc2/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:24.616416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 807/1594] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:24 2022] PUT /identity/v3/projects/576ee35ecff64e7dadf3c174b0a6f348/users/707fc75182aa430ca16da14982d5733a/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:24.617175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.617283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.699011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4f68-5732-43f4-80bc-7b434a6af6fa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.700640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60384-0dbe-421d-b7ce-bfca4721aad8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.703858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.704466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.704748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.705026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.705500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.705679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.706172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.706551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.707039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.707639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.707771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.709375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.718272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 808/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.721623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.721779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 788/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.722366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.731838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b33a1-c5f1-4bae-ab22-8c0fc61f8ef5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.733000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60973-c381-44c8-bc97-893d6b93df09 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.736554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.737148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.737967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.738451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.738639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ecc18-2afa-435f-a0cb-e878eff38651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.739031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.739184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ecc18-2afa-435f-a0cb-e878eff38651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.739574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ecc18-2afa-435f-a0cb-e878eff38651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.739849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ecc18-2afa-435f-a0cb-e878eff38651 admin admin] PATH_INFO: `/v3/projects/586c3dd15a24423cbefbb2626c676d8d/users/5d09391e1f40433a9b83098261167c43/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.740678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.751561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 809/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:24.752367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:24.757305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ecc18-2afa-435f-a0cb-e878eff38651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586c3dd15a24423cbefbb2626c676d8d, user_id=5d09391e1f40433a9b83098261167c43, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.760101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ecc18-2afa-435f-a0cb-e878eff38651 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.763774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a04cc4-8fcc-4530-8f0a-2f2cdbdd4caa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:24.770823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab00ba4-045e-45f5-a3a4-be96dd48ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:24.771519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab00ba4-045e-45f5-a3a4-be96dd48ee6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.771804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab00ba4-045e-45f5-a3a4-be96dd48ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.772080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab00ba4-045e-45f5-a3a4-be96dd48ee6d admin admin] PATH_INFO: `/v3/projects/451c0ff147cb4625811c781546d28862/users/d8746f97fe904ea29de76150a817a2b2/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.788239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:24.794071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab00ba4-045e-45f5-a3a4-be96dd48ee6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=451c0ff147cb4625811c781546d28862, user_id=d8746f97fe904ea29de76150a817a2b2, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:24.795783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab00ba4-045e-45f5-a3a4-be96dd48ee6d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:24.877362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 789/1598] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:24 2022] PUT /identity/v3/projects/586c3dd15a24423cbefbb2626c676d8d/users/5d09391e1f40433a9b83098261167c43/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:24.879112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04c2d-8108-4e44-944f-0409aa9b7db2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.879558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04c2d-8108-4e44-944f-0409aa9b7db2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.879934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04c2d-8108-4e44-944f-0409aa9b7db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.914279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 810/1599] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:24 2022] PUT /identity/v3/projects/451c0ff147cb4625811c781546d28862/users/d8746f97fe904ea29de76150a817a2b2/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:24.921529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e67e-774b-4143-ad55-7dcf66309595 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:24.921529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e67e-774b-4143-ad55-7dcf66309595 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:24.921529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586e67e-774b-4143-ad55-7dcf66309595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:24.921874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6eb04c2d-8108-4e44-944f-0409aa9b7db2 None None] MFA Rules not processed for user `e669ba23bc374299b3728511aeff1fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:24.921874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6eb04c2d-8108-4e44-944f-0409aa9b7db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:24.937878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2586e67e-774b-4143-ad55-7dcf66309595 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:24.939383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2586e67e-774b-4143-ad55-7dcf66309595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:24.996152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 790/1600] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:24.997008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb04c2d-8108-4e44-944f-0409aa9b7db2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.009263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 811/1601] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:25.009263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e67e-774b-4143-ad55-7dcf66309595 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.017128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586e67e-774b-4143-ad55-7dcf66309595 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.022730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.023351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.023850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.024178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.024839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.026460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.038668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 812/1602] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:25.039566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.050935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528dec0-2b9d-407b-a18d-3820d7658469 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.056356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:25.057807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff41e4-b088-4b62-adec-75b8476a9b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.058599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff41e4-b088-4b62-adec-75b8476a9b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.058881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff41e4-b088-4b62-adec-75b8476a9b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.059304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff41e4-b088-4b62-adec-75b8476a9b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.059955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff41e4-b088-4b62-adec-75b8476a9b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.061897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff41e4-b088-4b62-adec-75b8476a9b71 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.078472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 813/1603] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:25.083646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59f35-f5fb-4dd8-a493-6f732158653a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.083835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb04c2d-8108-4e44-944f-0409aa9b7db2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.083967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59f35-f5fb-4dd8-a493-6f732158653a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.084306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f59f35-f5fb-4dd8-a493-6f732158653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.093811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a553d28-25b8-4f39-979f-d9f4e9f78ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.093811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553d28-25b8-4f39-979f-d9f4e9f78ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.094211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553d28-25b8-4f39-979f-d9f4e9f78ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.094519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553d28-25b8-4f39-979f-d9f4e9f78ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.095209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a553d28-25b8-4f39-979f-d9f4e9f78ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.098155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a553d28-25b8-4f39-979f-d9f4e9f78ca1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.109765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 791/1604] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:25.111332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7771ac-b24d-4693-a527-5298aeea69cd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.111653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7771ac-b24d-4693-a527-5298aeea69cd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.111931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7771ac-b24d-4693-a527-5298aeea69cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.127219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-09f59f35-f5fb-4dd8-a493-6f732158653a None None] MFA Rules not processed for user `5d09391e1f40433a9b83098261167c43`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:25.129153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-09f59f35-f5fb-4dd8-a493-6f732158653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:25.132542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-af7771ac-b24d-4693-a527-5298aeea69cd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:25.133748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af7771ac-b24d-4693-a527-5298aeea69cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:25.142605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 792/1605] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:25.143513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7771ac-b24d-4693-a527-5298aeea69cd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.209632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 814/1606] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:25.210542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7771ac-b24d-4693-a527-5298aeea69cd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.211088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f59f35-f5fb-4dd8-a493-6f732158653a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.216037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.216817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.217097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.217380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.232724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.236645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.253564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 793/1607] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:25.254950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.266223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf793cad-20ae-4446-a5c9-1c8121ab4230 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.272512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.273195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.273475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.273873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] PATH_INFO: `/v3/projects/fbf09803683d4f62b69ec06cd065b2c0/users/c36bb346cba0459e90a9b02d5914ad2e/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.277440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f59f35-f5fb-4dd8-a493-6f732158653a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.284142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.285321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.285686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.286123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.291821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf09803683d4f62b69ec06cd065b2c0, user_id=c36bb346cba0459e90a9b02d5914ad2e, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.299314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.299553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.299553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.308055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 815/1608] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:25.308862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.313844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:25.320254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba25fe-15c1-4c53-9e6b-24c93d362277 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.325027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.331023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.331023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.331023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] PATH_INFO: `/v3/projects/ecab122c732d41ceb62c416b35fd090a/users/07b9f5357ea8402287c7929a12736552/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.341219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecab122c732d41ceb62c416b35fd090a, user_id=07b9f5357ea8402287c7929a12736552, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.343894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.438494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 794/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:25 2022] PUT /identity/v3/projects/fbf09803683d4f62b69ec06cd065b2c0/users/c36bb346cba0459e90a9b02d5914ad2e/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:25.439724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.475319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 816/1610] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:25 2022] PUT /identity/v3/projects/ecab122c732d41ceb62c416b35fd090a/users/07b9f5357ea8402287c7929a12736552/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:25.476227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.540929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87611e9-ca03-4a62-8241-f8231f871771 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.551946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d19d1-cefe-4bd0-a291-4858be950b14 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.558534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537cdc8-2cb6-429a-baa1-03e405bbba81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.559153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537cdc8-2cb6-429a-baa1-03e405bbba81 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.559469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537cdc8-2cb6-429a-baa1-03e405bbba81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.559755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537cdc8-2cb6-429a-baa1-03e405bbba81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.616104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:25.624743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db12b3-b3a2-48f4-b55d-e88d1a716abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.626589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db12b3-b3a2-48f4-b55d-e88d1a716abf admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.626924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db12b3-b3a2-48f4-b55d-e88d1a716abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.627206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db12b3-b3a2-48f4-b55d-e88d1a716abf admin admin] PATH_INFO: `/v3/projects/16a6f180f0824880b73d35576a62be15/users/442a196ea29942b682a170dc9b7ef607/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.642176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537cdc8-2cb6-429a-baa1-03e405bbba81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.643406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db12b3-b3a2-48f4-b55d-e88d1a716abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a6f180f0824880b73d35576a62be15, user_id=442a196ea29942b682a170dc9b7ef607, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.644206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537cdc8-2cb6-429a-baa1-03e405bbba81 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.646125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db12b3-b3a2-48f4-b55d-e88d1a716abf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.654251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 817/1611] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:25.655539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397907e-8d91-4e67-8acc-0cae2a7a0996 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.655825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397907e-8d91-4e67-8acc-0cae2a7a0996 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.656102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397907e-8d91-4e67-8acc-0cae2a7a0996 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.657351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 818/1612] 10.222.0.49 () {54 vars in 961 bytes} [Mon Sep 26 12:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:34:25.663310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b069-e699-4cbf-b473-9148300ad59e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.667552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b069-e699-4cbf-b473-9148300ad59e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.667552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b069-e699-4cbf-b473-9148300ad59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.698128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9d75b069-e699-4cbf-b473-9148300ad59e None None] MFA Rules not processed for user `c36bb346cba0459e90a9b02d5914ad2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:25.699566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9d75b069-e699-4cbf-b473-9148300ad59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:25.726483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 795/1613] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:25 2022] PUT /identity/v3/projects/16a6f180f0824880b73d35576a62be15/users/442a196ea29942b682a170dc9b7ef607/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:25.730678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b23b0-82ba-4631-9c51-942a4708448d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.730678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b23b0-82ba-4631-9c51-942a4708448d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.730678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b23b0-82ba-4631-9c51-942a4708448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.751412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-550b23b0-82ba-4631-9c51-942a4708448d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:25.752899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-550b23b0-82ba-4631-9c51-942a4708448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:25.781935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 819/1614] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:25.788243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208df4d-a5fd-4e18-915d-e0d4c58e0cc5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.788243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208df4d-a5fd-4e18-915d-e0d4c58e0cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.788243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208df4d-a5fd-4e18-915d-e0d4c58e0cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.845081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 796/1615] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:25.848841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f8876-62d6-4d90-bdd7-c8d20cfe924a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.849396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f8876-62d6-4d90-bdd7-c8d20cfe924a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.849885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f8876-62d6-4d90-bdd7-c8d20cfe924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.860403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5208df4d-a5fd-4e18-915d-e0d4c58e0cc5 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:25.861393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5208df4d-a5fd-4e18-915d-e0d4c58e0cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:25.903873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b39f8876-62d6-4d90-bdd7-c8d20cfe924a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:25.908957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b39f8876-62d6-4d90-bdd7-c8d20cfe924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:25.925499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 797/1616] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:25.926576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f8876-62d6-4d90-bdd7-c8d20cfe924a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:25.936834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f8876-62d6-4d90-bdd7-c8d20cfe924a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:25.942992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:25.943761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:25.944033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:25.944313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:25.945030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:25.947062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:25.976800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 820/1617] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Sep 26 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:25.978018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208df4d-a5fd-4e18-915d-e0d4c58e0cc5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:26.033741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208df4d-a5fd-4e18-915d-e0d4c58e0cc5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:26.038672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:26.039381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:26.039675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:26.041212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:26.050597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:26.052538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:26.064010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 821/1618] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:26.065034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:26.077490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ae901-08ae-4540-a7e7-e8a89c59a470 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:26.083097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:26.084186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 798/1619] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:25 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:26.084436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:26.087032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:26.087032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:26.087970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:26.101082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:26.102822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:26.116417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 822/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:26.117468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:26.133890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b23bb-5ca3-462c-a31d-b79612e4f16d service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:26.181248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:26.248874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:26.249489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:26.249777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:26.250052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:26.250723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:26.252676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:26.257418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4b8a3-6acd-422b-bc78-43176933c386 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:26.266784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:26.267563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:26.267917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:26.268291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:26.336597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 823/1621] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:26 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:26.339056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:26.341538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:26.353841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:26.355200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee4d73-812f-47d6-8b6c-16d6b2e89fc9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:26.356497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:26.368119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:26.368741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:26.369016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:26.370026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 799/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:26.370239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:26.370909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:26.372548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:26.397639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 824/1623] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:34:26.401812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:26.419475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d951-977f-4caa-899f-bd2f85efc238 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:26.427833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d163be-9b25-4fef-b075-ef51d64280e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:26.428920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d163be-9b25-4fef-b075-ef51d64280e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:26.429397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d163be-9b25-4fef-b075-ef51d64280e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:26.429726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d163be-9b25-4fef-b075-ef51d64280e3 admin admin] PATH_INFO: `/v3/projects/8b35d7a5365d4a45952e9aa9d8e8723e/users/c8892bcd08944a5aad37a782eea4cae1/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:26.483205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d163be-9b25-4fef-b075-ef51d64280e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b35d7a5365d4a45952e9aa9d8e8723e, user_id=c8892bcd08944a5aad37a782eea4cae1, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:26.486980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d163be-9b25-4fef-b075-ef51d64280e3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:26.601571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 800/1624] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:26 2022] PUT /identity/v3/projects/8b35d7a5365d4a45952e9aa9d8e8723e/users/c8892bcd08944a5aad37a782eea4cae1/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:26.606562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:26.622415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee44c7-00fd-4e40-868a-bbe0f6622da6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:27.010160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:27.010160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.010160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.010160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.012588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:27.012588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:27.013261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336b8d0-2f3b-4cb6-9676-5d134e09c392 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.013261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336b8d0-2f3b-4cb6-9676-5d134e09c392 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.013261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336b8d0-2f3b-4cb6-9676-5d134e09c392 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.013261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 801/1625] 10.222.0.49 () {54 vars in 912 bytes} [Mon Sep 26 12:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:34:27.013261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4080b-cacb-4a8c-9831-0643601c62d4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.013261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4080b-cacb-4a8c-9831-0643601c62d4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.014647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4080b-cacb-4a8c-9831-0643601c62d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.015292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 825/1626] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:34:27.015292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:27.015780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8cd4080b-cacb-4a8c-9831-0643601c62d4 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:27.015959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac44dac-1d51-4220-a53c-b4171656b055 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:27.016030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8cd4080b-cacb-4a8c-9831-0643601c62d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:27.016099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd045b3e-3ce0-4264-a86e-c40083a36755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:27.016099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd045b3e-3ce0-4264-a86e-c40083a36755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.016099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd045b3e-3ce0-4264-a86e-c40083a36755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.016099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd045b3e-3ce0-4264-a86e-c40083a36755 admin admin] PATH_INFO: `/v3/projects/8b35d7a5365d4a45952e9aa9d8e8723e/users/c8892bcd08944a5aad37a782eea4cae1/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.016357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd045b3e-3ce0-4264-a86e-c40083a36755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b35d7a5365d4a45952e9aa9d8e8723e, user_id=c8892bcd08944a5aad37a782eea4cae1, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:27.016357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd045b3e-3ce0-4264-a86e-c40083a36755 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:27.016357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 826/1627] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:26 2022] PUT /identity/v3/projects/8b35d7a5365d4a45952e9aa9d8e8723e/users/c8892bcd08944a5aad37a782eea4cae1/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:27.016357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21eb03-f243-40a0-92b1-7873baec560c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.016357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21eb03-f243-40a0-92b1-7873baec560c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.016357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21eb03-f243-40a0-92b1-7873baec560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.016710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6d21eb03-f243-40a0-92b1-7873baec560c None None] MFA Rules not processed for user `c8892bcd08944a5aad37a782eea4cae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:27.016710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6d21eb03-f243-40a0-92b1-7873baec560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:27.016851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 802/1628] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:34:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:27.016851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4080b-cacb-4a8c-9831-0643601c62d4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:27.063062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 827/1629] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:27.078208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21eb03-f243-40a0-92b1-7873baec560c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:27.082894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4080b-cacb-4a8c-9831-0643601c62d4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:27.155886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4660022-de59-4505-b0c1-1cd10c59e462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:27.156939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4660022-de59-4505-b0c1-1cd10c59e462 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.157479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4660022-de59-4505-b0c1-1cd10c59e462 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.157890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4660022-de59-4505-b0c1-1cd10c59e462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.160899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21eb03-f243-40a0-92b1-7873baec560c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:27.168548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:27.169518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.169899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.171120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.186145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:27.188368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:27.215485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 828/1630] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:34:27.285980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4660022-de59-4505-b0c1-1cd10c59e462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:27.287978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4660022-de59-4505-b0c1-1cd10c59e462 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:27.314624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 803/1631] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:27.444663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:27.539364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:27.549598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595e569-7810-43ff-8b78-1e8cb1ab04b8 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:27.554573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1a7d8-3da0-49e2-ae2e-e493e9a01203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:27.555245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a7d8-3da0-49e2-ae2e-e493e9a01203 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:27.555642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a7d8-3da0-49e2-ae2e-e493e9a01203 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:27.555921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a7d8-3da0-49e2-ae2e-e493e9a01203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:27.642242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1a7d8-3da0-49e2-ae2e-e493e9a01203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:27.644449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1a7d8-3da0-49e2-ae2e-e493e9a01203 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:27.660323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 829/1632] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:27.769693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:29.014464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabd5c2-0778-42fe-b105-53e6e2bfd3c9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:29.015146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabd5c2-0778-42fe-b105-53e6e2bfd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:29.015146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabd5c2-0778-42fe-b105-53e6e2bfd3c9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:29.016670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 804/1633] 10.222.0.49 () {54 vars in 961 bytes} [Mon Sep 26 12:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:34:29.037180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec588421-5923-4e6b-bce4-cbfa588392d8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:29.037823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec588421-5923-4e6b-bce4-cbfa588392d8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:29.037916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec588421-5923-4e6b-bce4-cbfa588392d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:29.077776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ec588421-5923-4e6b-bce4-cbfa588392d8 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:29.079652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ec588421-5923-4e6b-bce4-cbfa588392d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:29.101803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 830/1634] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Sep 26 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:29.107561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9c29-b7ed-435b-b937-7526b6ea8854 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:29.107907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9c29-b7ed-435b-b937-7526b6ea8854 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:29.108179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b9c29-b7ed-435b-b937-7526b6ea8854 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:29.110181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 805/1635] 10.222.0.49 () {54 vars in 912 bytes} [Mon Sep 26 12:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:34:29.128829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7349a-a066-442f-9a53-bcd632ac77a2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:29.128829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7349a-a066-442f-9a53-bcd632ac77a2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:29.128829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7349a-a066-442f-9a53-bcd632ac77a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:29.154401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-38b7349a-a066-442f-9a53-bcd632ac77a2 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:29.156283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-38b7349a-a066-442f-9a53-bcd632ac77a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:29.169659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 831/1636] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:29.182965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9c29-b7ed-435b-b937-7526b6ea8854 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:29.199308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b9c29-b7ed-435b-b937-7526b6ea8854 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:29.206502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:29.208348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:29.209021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:29.209526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:29.225629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:29.227979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:29.247009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 806/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:29.305798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:29.404521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14777a-73e8-415b-ad89-0d6b4bd0b5b9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:29.404521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14777a-73e8-415b-ad89-0d6b4bd0b5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:29.416927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14777a-73e8-415b-ad89-0d6b4bd0b5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:29.461586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6b14777a-73e8-415b-ad89-0d6b4bd0b5b9 None None] MFA Rules not processed for user `07b9f5357ea8402287c7929a12736552`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:29.463907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6b14777a-73e8-415b-ad89-0d6b4bd0b5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:29.568115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 832/1638] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:29.572360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:29.768005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005982f2-7a9b-457c-bb43-231cf2ab1eaf service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:29.786980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:29.787657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:29.790458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:29.790458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:29.790458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:29.791008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:29.982082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 807/1639] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:29 2022] POST /identity/v3/projects => generated 403 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:29.994939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14777a-73e8-415b-ad89-0d6b4bd0b5b9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:30.030488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14777a-73e8-415b-ad89-0d6b4bd0b5b9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:30.173135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:30.173789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:30.174146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:30.174419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:30.175197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:30.177828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:30.315841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 833/1640] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:29 2022] POST /identity/v3/users => generated 308 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:30.320123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:30.339155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61626ee9-bced-4f5e-88f3-7457fbf22aa3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:30.353128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:30.356487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:30.356487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:30.356487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:30.356487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:30.357621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:30.383428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 808/1641] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:30.388019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:30.399941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1b00b-819f-4f22-ad36-1004a295b75e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:30.407231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:30.409220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:30.409797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:30.410166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] PATH_INFO: `/v3/projects/e7d1c62dc7bf41649b9d78197e713956/users/66e910c7c0764629a8373ef02840a6b2/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:30.444795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d1c62dc7bf41649b9d78197e713956, user_id=66e910c7c0764629a8373ef02840a6b2, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:30.448150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:30.577430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 834/1642] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:30 2022] PUT /identity/v3/projects/e7d1c62dc7bf41649b9d78197e713956/users/66e910c7c0764629a8373ef02840a6b2/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:30.579096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:30.609064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea762e-3c83-4f0b-aa45-54cea68697aa admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:30.781032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:30.782364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:30.783078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:30.784463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:30.786057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:30.791830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:30.811380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 809/1643] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:30.815979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:30.838472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e322a-d330-463e-9f47-a3046e2046ad admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:30.847976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084050e-08af-4672-8a82-8bac59bd24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:30.849213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084050e-08af-4672-8a82-8bac59bd24de admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:30.849898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084050e-08af-4672-8a82-8bac59bd24de admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:30.850726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084050e-08af-4672-8a82-8bac59bd24de admin admin] PATH_INFO: `/v3/projects/e7d1c62dc7bf41649b9d78197e713956/users/66e910c7c0764629a8373ef02840a6b2/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:30.853836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084050e-08af-4672-8a82-8bac59bd24de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d1c62dc7bf41649b9d78197e713956, user_id=66e910c7c0764629a8373ef02840a6b2, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:30.857586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084050e-08af-4672-8a82-8bac59bd24de admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:30.882053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 835/1644] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:30 2022] PUT /identity/v3/projects/e7d1c62dc7bf41649b9d78197e713956/users/66e910c7c0764629a8373ef02840a6b2/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:34:31.543830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:31.909111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:31.929784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377372d-04bf-4127-95e7-3f1d061cdf46 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:31.953202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:32.152727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:32.153767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:32.154470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:32.155497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] PATH_INFO: `/v3/users/5d09391e1f40433a9b83098261167c43` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:32.158899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d09391e1f40433a9b83098261167c43)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:32.167486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:34:32.167486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: warnings.warn(msg) Sep 26 12:34:32.167486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: Sep 26 12:34:32.171729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:32.605508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d09391e1f40433a9b83098261167c43'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:32.741993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d09391e1f40433a9b83098261167c43'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:32.778359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d09391e1f40433a9b83098261167c43'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:32.784607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d09391e1f40433a9b83098261167c43'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:32.822838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d09391e1f40433a9b83098261167c43'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:32.842368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 810/1645] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:34:31 2022] DELETE /identity/v3/users/5d09391e1f40433a9b83098261167c43 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:32.847091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dba212-f8d7-468f-a39e-514ce79255ee None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:32.847640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dba212-f8d7-468f-a39e-514ce79255ee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:32.847640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dba212-f8d7-468f-a39e-514ce79255ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:32.905585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-97dba212-f8d7-468f-a39e-514ce79255ee None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:32.910102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-97dba212-f8d7-468f-a39e-514ce79255ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:33.179375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 836/1646] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:33.286813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:33.290250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:33.450009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914bfb7-c653-4dd9-b6ea-09e71ee21a63 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:33.461223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:33.466305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:33.466799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:33.467086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:33.486334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:33.490134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:33.520872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 811/1647] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:34:34.840874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2211-0af0-4d3e-9b1f-fb092cd211a6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:34.841410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2211-0af0-4d3e-9b1f-fb092cd211a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:34.841410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d2211-0af0-4d3e-9b1f-fb092cd211a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:34.904782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6f9d2211-0af0-4d3e-9b1f-fb092cd211a6 None None] MFA Rules not processed for user `66e910c7c0764629a8373ef02840a6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:34.924434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6f9d2211-0af0-4d3e-9b1f-fb092cd211a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:35.129687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 837/1648] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:36.594474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:36.597245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:36.638024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681624c8-7eef-465b-abd2-81d417844407 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:36.642652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:36.644450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:36.645012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:36.645537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] PATH_INFO: `/v3/projects/586c3dd15a24423cbefbb2626c676d8d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:36.647033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586c3dd15a24423cbefbb2626c676d8d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:36.655212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:36.845838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:36.895333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586c3dd15a24423cbefbb2626c676d8d', 'request_id': 'req-0b4c1967-3a29-430f-9853-f91809e1ee50'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:37.110707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586c3dd15a24423cbefbb2626c676d8d', 'request_id': 'req-0b4c1967-3a29-430f-9853-f91809e1ee50'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:37.133066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586c3dd15a24423cbefbb2626c676d8d', 'request_id': 'req-0b4c1967-3a29-430f-9853-f91809e1ee50'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:37.175899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] The token cache is being invalidate because project 586c3dd15a24423cbefbb2626c676d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:34:37.182237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:37.183462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b4c1967-3a29-430f-9853-f91809e1ee50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:37.195333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 812/1649] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:34:36 2022] DELETE /identity/v3/projects/586c3dd15a24423cbefbb2626c676d8d => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:37.197390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbd3a-b22a-46a3-beef-e8b6d6c64c1a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:37.197894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbd3a-b22a-46a3-beef-e8b6d6c64c1a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:37.198307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbd3a-b22a-46a3-beef-e8b6d6c64c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:37.259222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b7cdbd3a-b22a-46a3-beef-e8b6d6c64c1a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:37.265442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b7cdbd3a-b22a-46a3-beef-e8b6d6c64c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:37.437520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 838/1650] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:37.445526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812edf40-eddb-4c68-a43d-dc77aeea73c1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:37.446347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812edf40-eddb-4c68-a43d-dc77aeea73c1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:37.446775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812edf40-eddb-4c68-a43d-dc77aeea73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:37.482496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-812edf40-eddb-4c68-a43d-dc77aeea73c1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:37.484054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-812edf40-eddb-4c68-a43d-dc77aeea73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:37.498667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 813/1651] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:37.499324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdbd3a-b22a-46a3-beef-e8b6d6c64c1a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:37.512085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdbd3a-b22a-46a3-beef-e8b6d6c64c1a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:37.517725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c76cfa-95f1-48d6-bfda-8f85aee1194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:37.519627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c76cfa-95f1-48d6-bfda-8f85aee1194d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:37.520135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c76cfa-95f1-48d6-bfda-8f85aee1194d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:37.520628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c76cfa-95f1-48d6-bfda-8f85aee1194d admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:37.521502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c76cfa-95f1-48d6-bfda-8f85aee1194d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:37.521990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c76cfa-95f1-48d6-bfda-8f85aee1194d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:37.524590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c76cfa-95f1-48d6-bfda-8f85aee1194d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:37.528381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:37.567445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 839/1652] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:34:37.572380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812edf40-eddb-4c68-a43d-dc77aeea73c1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:37.609145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6203-f2a0-4f24-89c7-8d76e253b2e2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:37.610532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812edf40-eddb-4c68-a43d-dc77aeea73c1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:37.612908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6203-f2a0-4f24-89c7-8d76e253b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:37.614909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6203-f2a0-4f24-89c7-8d76e253b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:37.628944 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:37.630568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:37.633341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:37.633868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:37.634729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:37.641477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:37.678711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-26de6203-f2a0-4f24-89c7-8d76e253b2e2 None None] MFA Rules not processed for user `707fc75182aa430ca16da14982d5733a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:37.683556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-26de6203-f2a0-4f24-89c7-8d76e253b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:37.812741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 840/1653] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:37.830444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4f953-e44f-4a07-8d2d-f4d119940596 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:37.832582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4f953-e44f-4a07-8d2d-f4d119940596 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:37.833033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4f953-e44f-4a07-8d2d-f4d119940596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:37.850390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 814/1654] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:37 2022] POST /identity/v3/projects => generated 403 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:37.853356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:37.902970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0fc4f953-e44f-4a07-8d2d-f4d119940596 None None] MFA Rules not processed for user `707fc75182aa430ca16da14982d5733a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:37.904022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0fc4f953-e44f-4a07-8d2d-f4d119940596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:37.981745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e498a-b22e-4413-b432-bb3e39a5de86 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:37.990869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6dd53-e626-48ed-983d-0862e9142b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:37.992365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6dd53-e626-48ed-983d-0862e9142b03 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:37.992895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6dd53-e626-48ed-983d-0862e9142b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:37.993449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6dd53-e626-48ed-983d-0862e9142b03 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:37.995403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6dd53-e626-48ed-983d-0862e9142b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:37.999473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6dd53-e626-48ed-983d-0862e9142b03 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:38.103396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 841/1655] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:38.117238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b249-9cbf-4f6f-aa22-17b440fe23d6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.117749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b249-9cbf-4f6f-aa22-17b440fe23d6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.118127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64b249-9cbf-4f6f-aa22-17b440fe23d6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.120526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 842/1656] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:34:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:34:38.122711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64b249-9cbf-4f6f-aa22-17b440fe23d6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:38.131363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6a64b249-9cbf-4f6f-aa22-17b440fe23d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:38.223997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 815/1657] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:37 2022] POST /identity/v3/users => generated 302 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:38.223997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.223997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.223997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.240932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64b249-9cbf-4f6f-aa22-17b440fe23d6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:38.259933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:38.261111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.261338 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.261679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.276615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:38.279714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:38.292030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:38.295719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:38.296658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 843/1658] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:38.298480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:38.327474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97281bd1-f9e7-4063-8aab-bd5be00bdfa4 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:38.339358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:38.340298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.340965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.341388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.342238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:38.344722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:38.367027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 844/1659] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:38.368417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:38.384785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df06f4-9cf1-407d-962f-45c1edc237ba admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:38.394790 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:38.395729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.396984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.397430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.398298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:38.419907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:38.459646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 845/1660] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:38.461994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:38.506802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975dd4d-5487-4da7-beff-8411dfbdcee9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:38.515382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 816/1661] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:38.542018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:38.544726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.545024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.545308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] PATH_INFO: `/v3/projects/c4ab2e99b0944f3aad2bd80f83056c9d/users/b7e1a0bcbdc44cfeae2db66fa6bbc020/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.570698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:38.576109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:38.606005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e1d9c-c9c5-46d0-a76f-10f6a839c5ca None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:38.622206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22259c4d-fc0e-47c1-b1f4-52b621352271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:38.623125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259c4d-fc0e-47c1-b1f4-52b621352271 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.623435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259c4d-fc0e-47c1-b1f4-52b621352271 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.623758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22259c4d-fc0e-47c1-b1f4-52b621352271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.631420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ab2e99b0944f3aad2bd80f83056c9d, user_id=b7e1a0bcbdc44cfeae2db66fa6bbc020, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:38.634321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:38.653947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22259c4d-fc0e-47c1-b1f4-52b621352271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:38.659113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22259c4d-fc0e-47c1-b1f4-52b621352271 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:38.727285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 817/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:38.743908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 846/1663] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:38 2022] PUT /identity/v3/projects/c4ab2e99b0944f3aad2bd80f83056c9d/users/b7e1a0bcbdc44cfeae2db66fa6bbc020/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:38.757101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014be4f4-f456-45e8-bb12-52b5ebf5e550 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:38.757404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014be4f4-f456-45e8-bb12-52b5ebf5e550 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:38.757845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014be4f4-f456-45e8-bb12-52b5ebf5e550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:38.824160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-014be4f4-f456-45e8-bb12-52b5ebf5e550 None None] MFA Rules not processed for user `b7e1a0bcbdc44cfeae2db66fa6bbc020`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:38.825485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-014be4f4-f456-45e8-bb12-52b5ebf5e550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:39.024624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 818/1664] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:39.028690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:39.201923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e6a86-8852-45e9-b96e-d166ae775674 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:39.220079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:39.221873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:39.222179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:39.222611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:39.226538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:39.228644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:39.339613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:39.383703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 847/1665] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:39 2022] POST /identity/v3/projects => generated 405 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:39.386970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014be4f4-f456-45e8-bb12-52b5ebf5e550 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:39.413541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014be4f4-f456-45e8-bb12-52b5ebf5e550 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:39.585161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303a6f-3e3d-4ac3-9033-3ce27573a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:39.585834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303a6f-3e3d-4ac3-9033-3ce27573a12b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:39.586038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303a6f-3e3d-4ac3-9033-3ce27573a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:39.586257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303a6f-3e3d-4ac3-9033-3ce27573a12b admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:39.586917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75303a6f-3e3d-4ac3-9033-3ce27573a12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:39.588935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75303a6f-3e3d-4ac3-9033-3ce27573a12b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:39.716860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:39.747984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:39.749540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 819/1666] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:39 2022] POST /identity/v3/users => generated 309 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:39.776031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e345d3-8ce3-428a-b294-dccac6a26cd8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:39.780497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463d7b-4181-4186-b592-4f979bd57d98 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:39.780950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463d7b-4181-4186-b592-4f979bd57d98 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:39.781644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb463d7b-4181-4186-b592-4f979bd57d98 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:39.783159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 820/1667] 10.222.0.49 () {54 vars in 912 bytes} [Mon Sep 26 12:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:34:39.790260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:39.790820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:39.791290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:39.807630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:39.808517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:39.812460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:39.814819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:39.819913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:39.821862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:39.877424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 848/1668] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:39.889925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:39.927858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ed776-ff3e-4bdc-9849-5724a04bec4f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:39.942353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] MFA Rules not processed for user `5c06385b20074363b3a5f7216947280b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:39.943665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:39.949474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:39.950152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:39.950435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:39.950711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] PATH_INFO: `/v3/projects/d29e0f8daf654f89b04cdac38e8f3b36/users/8c58804fd042484d9b5a7cc19621a888/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:40.006696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29e0f8daf654f89b04cdac38e8f3b36, user_id=8c58804fd042484d9b5a7cc19621a888, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:40.011480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:40.114113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 849/1669] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:39 2022] PUT /identity/v3/projects/d29e0f8daf654f89b04cdac38e8f3b36/users/8c58804fd042484d9b5a7cc19621a888/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:40.121943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:40.150419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 821/1670] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:34:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:40.254382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:40.256139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:40.283678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8870ec5-1bfb-4789-8f36-46c703e528ba None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:40.324969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48ac54-456a-4356-974b-a3eb8ae7041d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:40.342271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:40.343650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:40.344107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:40.345207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:40.346032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:40.349101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:40.362956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 850/1671] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:40.368075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:40.403718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3319f1-5e53-4f0d-aedc-3e5a1f1cacab admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:40.438679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8be8fc-1700-4538-b462-7adbe2ac0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:40.438679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be8fc-1700-4538-b462-7adbe2ac0b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:40.438679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be8fc-1700-4538-b462-7adbe2ac0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:40.438679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be8fc-1700-4538-b462-7adbe2ac0b6a admin admin] PATH_INFO: `/v3/projects/d29e0f8daf654f89b04cdac38e8f3b36/users/8c58804fd042484d9b5a7cc19621a888/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:40.446194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8be8fc-1700-4538-b462-7adbe2ac0b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29e0f8daf654f89b04cdac38e8f3b36, user_id=8c58804fd042484d9b5a7cc19621a888, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:40.457688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8be8fc-1700-4538-b462-7adbe2ac0b6a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:40.485802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:40.489293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:40.489584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:40.500256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:40.524329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 851/1672] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:40 2022] PUT /identity/v3/projects/d29e0f8daf654f89b04cdac38e8f3b36/users/8c58804fd042484d9b5a7cc19621a888/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:40.529213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:40.532832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:40.533290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:40.542191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:40.551694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:40.566536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:40.587735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 822/1673] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:34:40.628014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] MFA Rules not processed for user `8c58804fd042484d9b5a7cc19621a888`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:40.628014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:40.666672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:40.668493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:40.695150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49ec71-6273-4a93-872e-3fdbd5599699 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:40.824148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 852/1674] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:40.876489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:40.878792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:40.951780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:40.951780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:40.952430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:40.952926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] PATH_INFO: `/v3/users/07b9f5357ea8402287c7929a12736552` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:40.954599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b9f5357ea8402287c7929a12736552)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:40.970536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:41.031769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e330f04-2d68-44c7-9fb2-f4248c9543b0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:41.035768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:41.036801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:41.036801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:41.037344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:41.048476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:41.051167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:41.066565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 853/1675] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:40 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:34:41.391243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:41.393406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b9f5357ea8402287c7929a12736552'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.409658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d85a5c-14db-4817-b8cc-77f9349119bc service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:41.422740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:41.423612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:41.424176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:41.425238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] PATH_INFO: `/v3/users/b7e1a0bcbdc44cfeae2db66fa6bbc020` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:41.428508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e1a0bcbdc44cfeae2db66fa6bbc020)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:41.430596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:41.490806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b9f5357ea8402287c7929a12736552'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.516698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b9f5357ea8402287c7929a12736552'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.517517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b9f5357ea8402287c7929a12736552'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.537962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b9f5357ea8402287c7929a12736552'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.556212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 823/1676] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:34:40 2022] DELETE /identity/v3/users/07b9f5357ea8402287c7929a12736552 => generated 0 bytes in 887 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:34:41.673318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:41.893816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:41.895734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:41.912133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e1a0bcbdc44cfeae2db66fa6bbc020'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.915087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e1a0bcbdc44cfeae2db66fa6bbc020'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.930740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e1a0bcbdc44cfeae2db66fa6bbc020'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:41.965113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e1a0bcbdc44cfeae2db66fa6bbc020'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:42.010138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7791c44-e0b5-4afc-94d1-082526772ce8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:42.015615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:42.016465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:42.016753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:42.017029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] PATH_INFO: `/v3/users/e669ba23bc374299b3728511aeff1fc2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:42.021607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e669ba23bc374299b3728511aeff1fc2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:42.023595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:42.350827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cbbcb1c-4efd-495f-9e02-10bca6ccac8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e1a0bcbdc44cfeae2db66fa6bbc020'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:42.370581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 854/1677] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:34:41 2022] DELETE /identity/v3/users/b7e1a0bcbdc44cfeae2db66fa6bbc020 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:42.370581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c837054-e1da-4da4-9405-7a87d16b22e1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:42.370581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c837054-e1da-4da4-9405-7a87d16b22e1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:42.370581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c837054-e1da-4da4-9405-7a87d16b22e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:42.443254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7c837054-e1da-4da4-9405-7a87d16b22e1 None None] MFA Rules not processed for user `442a196ea29942b682a170dc9b7ef607`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:42.446519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7c837054-e1da-4da4-9405-7a87d16b22e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:42.551696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 855/1678] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:42.551696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa2a75-4964-4f92-a897-9332d59960c9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:42.551696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa2a75-4964-4f92-a897-9332d59960c9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:42.551696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa2a75-4964-4f92-a897-9332d59960c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:42.585605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-52aa2a75-4964-4f92-a897-9332d59960c9 None None] MFA Rules not processed for user `e5496f0182f44d4d891959fe7422562c`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:42.587611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-52aa2a75-4964-4f92-a897-9332d59960c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:42.702600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 856/1679] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:42.702600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:42.702600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:42.702600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:42.748483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e669ba23bc374299b3728511aeff1fc2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:42.763467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:42.763467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:42.888078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e669ba23bc374299b3728511aeff1fc2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:42.917702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e669ba23bc374299b3728511aeff1fc2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:42.918556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e669ba23bc374299b3728511aeff1fc2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:42.920596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 857/1680] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:42.925286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:42.926820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:42.943455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e669ba23bc374299b3728511aeff1fc2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:42.958750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 824/1681] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:34:41 2022] DELETE /identity/v3/users/e669ba23bc374299b3728511aeff1fc2 => generated 0 bytes in 1066 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:42.960500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:42.962302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:43.096270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c2f08-3428-4f6a-8a3d-553a233e2bf3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:43.111620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:43.113739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:43.114815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:43.115164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] PATH_INFO: `/v3/projects/ecab122c732d41ceb62c416b35fd090a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:43.116809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711cf86-16da-4d8f-a5f8-9e5bdba17073 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:43.117968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecab122c732d41ceb62c416b35fd090a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:43.121392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:43.126228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:43.248854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:43.249852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:43.250441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:43.251014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:43.262745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:43.283585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:43.284355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:43.314953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecab122c732d41ceb62c416b35fd090a', 'request_id': 'req-176e0455-2854-4438-8be2-22087359c5a9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:43.315677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 858/1682] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:43.318712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:43.326925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:43.466580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df03c9-02a8-4a0a-91c7-5a48f17a65a2 service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:43.473741 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecab122c732d41ceb62c416b35fd090a', 'request_id': 'req-176e0455-2854-4438-8be2-22087359c5a9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:43.484595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecab122c732d41ceb62c416b35fd090a', 'request_id': 'req-176e0455-2854-4438-8be2-22087359c5a9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:43.511803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] The token cache is being invalidate because project ecab122c732d41ceb62c416b35fd090a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:34:43.512108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:43.515496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-176e0455-2854-4438-8be2-22087359c5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:43.519825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 825/1683] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:34:42 2022] DELETE /identity/v3/projects/ecab122c732d41ceb62c416b35fd090a => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:43.525962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:43.526311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:43.526596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:43.575213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] MFA Rules not processed for user `707fc75182aa430ca16da14982d5733a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:43.580373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:43.704310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 826/1684] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:43.716654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:43.721074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:43.743604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:43.744240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:43.744522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:43.744788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:43.758110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:43.968160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:43.969804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:43.985280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f00124-03c6-49d9-9b57-9a74aa0221b2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:43.998953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 859/1685] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:43.999831 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8816f-7d40-43f4-bd88-d28daefa4ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:43.999979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:44.000741 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8816f-7d40-43f4-bd88-d28daefa4ce1 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:44.001179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8816f-7d40-43f4-bd88-d28daefa4ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:44.003536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8816f-7d40-43f4-bd88-d28daefa4ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:44.004565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:44.010840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-afc8816f-7d40-43f4-bd88-d28daefa4ce1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:44.195874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16259a-b5dc-4bd2-9a99-ef0e30726600 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:44.205013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8816f-7d40-43f4-bd88-d28daefa4ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:44.208114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8816f-7d40-43f4-bd88-d28daefa4ce1 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:44.226003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:44.226634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:44.226920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:44.227193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:44.233515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 827/1686] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:44.235823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:44.235976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:44.237380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:44.239898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:44.268880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:44.273183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:44.276083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:44.424965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:44.430073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:44.457867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 860/1687] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:44.474846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:44.483298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:44.512181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 828/1688] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:44.527374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a9431-8eb9-4730-af00-fb193126131c service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:44.551064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:44.551799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:44.552141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:44.552488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] PATH_INFO: `/v3/users/66e910c7c0764629a8373ef02840a6b2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:44.554368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e910c7c0764629a8373ef02840a6b2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:44.560630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:44.712118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:44.715465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:44.745280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a22ce-5a8a-4c84-a5a1-64cbb3975402 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:44.761065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c63d92-8bcc-40f5-be68-cf347333468a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:44.761705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63d92-8bcc-40f5-be68-cf347333468a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:44.761981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63d92-8bcc-40f5-be68-cf347333468a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:44.762251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63d92-8bcc-40f5-be68-cf347333468a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:44.792754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c63d92-8bcc-40f5-be68-cf347333468a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:44.794345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c63d92-8bcc-40f5-be68-cf347333468a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:44.830294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 829/1689] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:44.872976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e910c7c0764629a8373ef02840a6b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:44.874519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e910c7c0764629a8373ef02840a6b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:44.890384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e910c7c0764629a8373ef02840a6b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:44.918162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:44.918451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:44.918728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:44.953367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e910c7c0764629a8373ef02840a6b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:45.001554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] MFA Rules not processed for user `d8746f97fe904ea29de76150a817a2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:45.004028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:45.116599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98a423ce-bab9-451f-87fd-86ea90f68106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e910c7c0764629a8373ef02840a6b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:45.123185 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 861/1690] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:34:44 2022] DELETE /identity/v3/users/66e910c7c0764629a8373ef02840a6b2 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:45.215686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 830/1691] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:45.227241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:45.227559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:45.227839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:45.295984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] MFA Rules not processed for user `d8746f97fe904ea29de76150a817a2b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:45.297955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:45.491059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 862/1692] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:45.500182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:45.501966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:45.537273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a599aa-2e6e-40b7-890d-363b1af0c28e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:45.800281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:45.801006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:45.801296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:45.801573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:45.824238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:45.826211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:45.854624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 831/1693] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:45.978692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:45.981135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:46.277545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:46.310470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:46.312213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:46.328727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bbc3d-bc48-4d90-8b49-c538587e0092 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:46.359805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:46.364423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8100347-d58c-4f65-92e7-7e5089b820e0 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:46.366207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:46.366539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:46.367880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] PATH_INFO: `/v3/projects/c4ab2e99b0944f3aad2bd80f83056c9d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:46.376251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ab2e99b0944f3aad2bd80f83056c9d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:46.381854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 12:34:46.381854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: warnings.warn(msg) Sep 26 12:34:46.381854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: Sep 26 12:34:46.390651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:46.394416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:46.395101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:46.395401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:46.395685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] PATH_INFO: `/v3/projects/e7d1c62dc7bf41649b9d78197e713956` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:46.417401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d1c62dc7bf41649b9d78197e713956)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:46.419651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:46.715930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ab2e99b0944f3aad2bd80f83056c9d', 'request_id': 'req-c5eae3f2-5c52-4429-937c-c219ca9ae436'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:46.955015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ab2e99b0944f3aad2bd80f83056c9d', 'request_id': 'req-c5eae3f2-5c52-4429-937c-c219ca9ae436'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:46.970860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ab2e99b0944f3aad2bd80f83056c9d', 'request_id': 'req-c5eae3f2-5c52-4429-937c-c219ca9ae436'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.017056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d1c62dc7bf41649b9d78197e713956', 'request_id': 'req-529a92db-79d9-4477-854a-2ee41aec2423'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.031772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] The token cache is being invalidate because project c4ab2e99b0944f3aad2bd80f83056c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:34:47.032440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.033448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.037838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 863/1694] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:34:45 2022] DELETE /identity/v3/projects/c4ab2e99b0944f3aad2bd80f83056c9d => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:47.039013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:47.040918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:47.135994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d1c62dc7bf41649b9d78197e713956', 'request_id': 'req-529a92db-79d9-4477-854a-2ee41aec2423'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.145080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d1c62dc7bf41649b9d78197e713956', 'request_id': 'req-529a92db-79d9-4477-854a-2ee41aec2423'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.172870 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] The token cache is being invalidate because project e7d1c62dc7bf41649b9d78197e713956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:34:47.173934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eae3f2-5c52-4429-937c-c219ca9ae436 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:47.174041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.176116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-529a92db-79d9-4477-854a-2ee41aec2423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.180641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 832/1695] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:34:46 2022] DELETE /identity/v3/projects/e7d1c62dc7bf41649b9d78197e713956 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:34:47.185578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e28c-f839-4dc9-95d9-fd9537b7782c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:47.187368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e28c-f839-4dc9-95d9-fd9537b7782c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:47.187811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e28c-f839-4dc9-95d9-fd9537b7782c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:47.190659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 833/1696] 10.222.0.49 () {54 vars in 912 bytes} [Mon Sep 26 12:34:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:34:47.191626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e28c-f839-4dc9-95d9-fd9537b7782c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:47.196923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1924e28c-f839-4dc9-95d9-fd9537b7782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:47.206279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:47.305438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:47.307172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:47.307822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:47.308351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] PATH_INFO: `/v3/projects/8e8d91b495a6465aa22a98350a2e83db` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:47.309907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8d91b495a6465aa22a98350a2e83db)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:47.312441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:47.359457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:47.364066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e28c-f839-4dc9-95d9-fd9537b7782c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:47.376800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:47.377565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:47.377840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:47.378119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] PATH_INFO: `/v3/users/8c58804fd042484d9b5a7cc19621a888` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:47.382823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c58804fd042484d9b5a7cc19621a888)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:47.392228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:47.584058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8d91b495a6465aa22a98350a2e83db', 'request_id': 'req-02ee73fd-0379-4f28-b722-4f3088a906d7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.683749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c58804fd042484d9b5a7cc19621a888'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.702236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8d91b495a6465aa22a98350a2e83db', 'request_id': 'req-02ee73fd-0379-4f28-b722-4f3088a906d7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.723231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8d91b495a6465aa22a98350a2e83db', 'request_id': 'req-02ee73fd-0379-4f28-b722-4f3088a906d7'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.766143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] The token cache is being invalidate because project 8e8d91b495a6465aa22a98350a2e83db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:34:47.766823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.795647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-02ee73fd-0379-4f28-b722-4f3088a906d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.802782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 864/1697] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:34:47 2022] DELETE /identity/v3/projects/8e8d91b495a6465aa22a98350a2e83db => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:47.804734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728998a6-9ba1-4c48-a7fb-b20fe398d181 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:47.805244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728998a6-9ba1-4c48-a7fb-b20fe398d181 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:47.805773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728998a6-9ba1-4c48-a7fb-b20fe398d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:47.831651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c58804fd042484d9b5a7cc19621a888'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.886387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c58804fd042484d9b5a7cc19621a888'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.887529 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c58804fd042484d9b5a7cc19621a888'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.890233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-728998a6-9ba1-4c48-a7fb-b20fe398d181 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:47.901763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ffaa4c05-62a9-43fe-95d6-b52e40aaf19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c58804fd042484d9b5a7cc19621a888'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:47.904467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-728998a6-9ba1-4c48-a7fb-b20fe398d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:47.915751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 834/1698] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:34:47 2022] DELETE /identity/v3/users/8c58804fd042484d9b5a7cc19621a888 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:47.918464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba278c-6c51-46d9-a4f2-c3e6fe4361a3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:47.918464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba278c-6c51-46d9-a4f2-c3e6fe4361a3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:47.918464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba278c-6c51-46d9-a4f2-c3e6fe4361a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:47.942771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-85ba278c-6c51-46d9-a4f2-c3e6fe4361a3 None None] MFA Rules not processed for user `5c06385b20074363b3a5f7216947280b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:47.944629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-85ba278c-6c51-46d9-a4f2-c3e6fe4361a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:48.153477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 865/1699] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:48.158331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.159179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.160980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.170043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 835/1700] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:48.172013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a3bd-4181-4159-bb75-7c7aaa23b8b0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.172305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a3bd-4181-4159-bb75-7c7aaa23b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.172636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a3bd-4181-4159-bb75-7c7aaa23b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.218146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:48.220981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:48.254815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7b34a3bd-4181-4159-bb75-7c7aaa23b8b0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:48.264168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7b34a3bd-4181-4159-bb75-7c7aaa23b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:48.333109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:48.379184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 866/1701] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:48.381055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:48.384740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:48.401341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492743c-6237-4c75-b2be-91ee89e796e7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:48.405943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f5cf7-1702-4455-aeed-f5bbdfa2ec53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:48.405943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f5cf7-1702-4455-aeed-f5bbdfa2ec53 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.406266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f5cf7-1702-4455-aeed-f5bbdfa2ec53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.406398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f5cf7-1702-4455-aeed-f5bbdfa2ec53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.449499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f5cf7-1702-4455-aeed-f5bbdfa2ec53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:48.453861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f5cf7-1702-4455-aeed-f5bbdfa2ec53 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:48.463877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 867/1702] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:48.465107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad17a0-b9fe-4198-b33d-fc7ad6808590 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.466034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad17a0-b9fe-4198-b33d-fc7ad6808590 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.466323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad17a0-b9fe-4198-b33d-fc7ad6808590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.474423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 836/1703] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:48.478876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a3bd-4181-4159-bb75-7c7aaa23b8b0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:48.494958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b0ad17a0-b9fe-4198-b33d-fc7ad6808590 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:48.496357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b0ad17a0-b9fe-4198-b33d-fc7ad6808590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:48.500572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a3bd-4181-4159-bb75-7c7aaa23b8b0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:48.507817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 868/1704] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:48.518694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:48.518694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.518978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad17a0-b9fe-4198-b33d-fc7ad6808590 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:48.519071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.519071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.519071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:48.519516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:48.524193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:48.526940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad17a0-b9fe-4198-b33d-fc7ad6808590 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:48.534997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:48.535705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.535986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.536252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.537145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:48.537448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:48.539767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:48.549241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 837/1705] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:34:48.558259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:48.566777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 869/1706] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:48.571671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:48.582133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c740e-36c7-41fa-bbd0-76241bc928f4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:48.592701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:48.598467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.598467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.598467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.598467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:48.598809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c554-4b9a-4c15-91af-864fa767e356 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:48.600283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:48.611606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:48.612471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:48.612948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:48.613315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:48.614263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:48.619788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:48.852840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 870/1707] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:48 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:48.854101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 838/1708] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:48 2022] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:48.855026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:48.859122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:48.993489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888e2f6-1739-46b9-afaf-22a1fe2e38c4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.001613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.004492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.005033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.005578 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.008457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.012596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.017295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fbee-672f-4b28-b953-1f6fbf65de9c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.029029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.029909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.030292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.030742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.032178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.041233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.146156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 871/1709] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:48 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:34:49.152329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 839/1710] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:48 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:49.154474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:49.156098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:49.177300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c6246-4aa8-4deb-b5dd-d6005c321b84 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.181728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b88523-8903-4e19-b132-a421ccab9066 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.196358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.197231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.197675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.198105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.198935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.207589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.208435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.210808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.211980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.221997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.221997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.221997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.242862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 872/1711] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:49.244676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:49.250185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 840/1712] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:49.258663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:49.277708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d840d3-b372-4d06-9a53-fd8467834efb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.288959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383981b7-5c98-480b-8745-c4110ef0678a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.294126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.297583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.298112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.302468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.303548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.313851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.316367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.317457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.319480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.319480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.319480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.322495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.362191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 873/1713] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:49.365839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 841/1714] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:49.369656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:49.371009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:49.384128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d3416-a6cc-4b65-adcb-c2ed66c9d781 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.401337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0cf0a-24c7-4753-bd38-7c0272c7a675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.402170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0cf0a-24c7-4753-bd38-7c0272c7a675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.402604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0cf0a-24c7-4753-bd38-7c0272c7a675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.402738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c381e5-e94d-459e-b813-1ce6e5f7e2c6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:49.403076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0cf0a-24c7-4753-bd38-7c0272c7a675 admin admin] PATH_INFO: `/v3/projects/69343df3c0a74e48a300ed803e0fabd6/users/0a4e0afb010847ef8f958228ca8d61f6/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.416047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661095-64d8-4a01-bc47-71473b0c891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:49.417072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661095-64d8-4a01-bc47-71473b0c891c admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.417369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661095-64d8-4a01-bc47-71473b0c891c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.417657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661095-64d8-4a01-bc47-71473b0c891c admin admin] PATH_INFO: `/v3/projects/5e9b93a7fac44296ad1752e035922766/users/6bb44de6ae4f4330a44c860d2f7ca2b9/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.436858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0cf0a-24c7-4753-bd38-7c0272c7a675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69343df3c0a74e48a300ed803e0fabd6, user_id=0a4e0afb010847ef8f958228ca8d61f6, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.442106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0cf0a-24c7-4753-bd38-7c0272c7a675 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.456845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661095-64d8-4a01-bc47-71473b0c891c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9b93a7fac44296ad1752e035922766, user_id=6bb44de6ae4f4330a44c860d2f7ca2b9, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:49.473409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661095-64d8-4a01-bc47-71473b0c891c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:49.637766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 842/1715] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:49 2022] PUT /identity/v3/projects/5e9b93a7fac44296ad1752e035922766/users/6bb44de6ae4f4330a44c860d2f7ca2b9/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:34:49.651281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0cbac-0268-420d-8bf7-ef800346f134 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.651824 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0cbac-0268-420d-8bf7-ef800346f134 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.652817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0cbac-0268-420d-8bf7-ef800346f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.655561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 874/1716] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:49 2022] PUT /identity/v3/projects/69343df3c0a74e48a300ed803e0fabd6/users/0a4e0afb010847ef8f958228ca8d61f6/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:49.677426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a74e8a-d5fb-4a94-873c-0f9d9b4b70a8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:49.678031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a74e8a-d5fb-4a94-873c-0f9d9b4b70a8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:49.678478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a74e8a-d5fb-4a94-873c-0f9d9b4b70a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:49.727251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-84a74e8a-d5fb-4a94-873c-0f9d9b4b70a8 None None] MFA Rules not processed for user `0a4e0afb010847ef8f958228ca8d61f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:49.729128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-84a74e8a-d5fb-4a94-873c-0f9d9b4b70a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:49.743294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e1d0cbac-0268-420d-8bf7-ef800346f134 None None] MFA Rules not processed for user `6bb44de6ae4f4330a44c860d2f7ca2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:49.744849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e1d0cbac-0268-420d-8bf7-ef800346f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:49.893724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 843/1717] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:49.899909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0cbac-0268-420d-8bf7-ef800346f134 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:50.003183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 875/1718] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:50.004732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:50.005023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:50.005301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:50.080207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0cbac-0268-420d-8bf7-ef800346f134 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:50.098468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:50.099318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:50.099862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:50.100257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:50.101118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:50.105554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:50.150088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:50.151502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:50.217918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 844/1719] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:49 2022] POST /identity/v3/projects => generated 363 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:50.218879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:50.340628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 876/1720] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:50.342296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:50.343787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:50.361021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cae270-15a8-4fa2-8e79-db18ea2746ec None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:50.413355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e08bc-61cd-49bb-b216-7f5068dec326 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:50.419752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:50.420395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:50.420678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:50.420947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:50.421602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:50.423867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:50.476287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:50.477103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:50.477393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:50.479170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] PATH_INFO: `/v3/projects/d29e0f8daf654f89b04cdac38e8f3b36` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:50.479170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29e0f8daf654f89b04cdac38e8f3b36)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:50.481374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:50.500009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:50.577070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 845/1721] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:50 2022] POST /identity/v3/projects => generated 381 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:50.578992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:50.724207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29e0f8daf654f89b04cdac38e8f3b36', 'request_id': 'req-f81dcc34-2976-483f-ad4e-25eb2f323e16'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:50.790606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7a92d-8b4e-4161-a1a1-fffca611f150 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:50.918205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29e0f8daf654f89b04cdac38e8f3b36', 'request_id': 'req-f81dcc34-2976-483f-ad4e-25eb2f323e16'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:50.921673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:50.924936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:50.924936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:50.924936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:50.924936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:50.929893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29e0f8daf654f89b04cdac38e8f3b36', 'request_id': 'req-f81dcc34-2976-483f-ad4e-25eb2f323e16'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:50.939844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:50.965274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] The token cache is being invalidate because project d29e0f8daf654f89b04cdac38e8f3b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:34:50.965274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:50.967788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:34:50.969417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 877/1722] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:34:50 2022] DELETE /identity/v3/projects/d29e0f8daf654f89b04cdac38e8f3b36 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:50.978904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:50.984420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:51.011144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dcc34-2976-483f-ad4e-25eb2f323e16 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:51.018285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d13da-9e48-4e67-b2da-9e4ceddef326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:51.019422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d13da-9e48-4e67-b2da-9e4ceddef326 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.021506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d13da-9e48-4e67-b2da-9e4ceddef326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.021985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d13da-9e48-4e67-b2da-9e4ceddef326 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.023498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d13da-9e48-4e67-b2da-9e4ceddef326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:51.025562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d13da-9e48-4e67-b2da-9e4ceddef326 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:51.075402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 846/1723] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:50 2022] POST /identity/v3/users => generated 288 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:51.075402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:51.077082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:51.102165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:51.165429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 878/1724] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:50 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:51.166931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684a0e-eee7-441f-aa52-fd01a7390d16 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.167363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684a0e-eee7-441f-aa52-fd01a7390d16 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.167798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5684a0e-eee7-441f-aa52-fd01a7390d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.216078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e5684a0e-eee7-441f-aa52-fd01a7390d16 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:51.218948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e5684a0e-eee7-441f-aa52-fd01a7390d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:51.233877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d10bd6-9b17-45c1-9b24-5637e326e43c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:51.245077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:51.246437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.246876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.247243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.252007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:51.316888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 879/1725] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:51.319391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca705-3d66-4e6d-b874-9828142d46fb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.319657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca705-3d66-4e6d-b874-9828142d46fb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.330494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca705-3d66-4e6d-b874-9828142d46fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.353982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:51.356549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:51.392421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-316ca705-3d66-4e6d-b874-9828142d46fb None None] MFA Rules not processed for user `e5496f0182f44d4d891959fe7422562c`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:51.396699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 847/1726] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:34:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:34:51.398555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:51.399547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-316ca705-3d66-4e6d-b874-9828142d46fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:51.410267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:51.530466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65dca-85fb-49c7-bf8d-9dac9cd1d958 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:51.550164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:51.551666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.553782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.555107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.559826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:51.562542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:51.621234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 848/1727] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:51.626619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:51.672703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7899d52-d237-42a7-9648-f8c0efddec0b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:51.693885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:51.694807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.696127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.696681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.697123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 880/1728] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:51.698252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:51.700976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:51.703991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8de1df-c061-4a74-92e3-643868cdc275 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.704518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8de1df-c061-4a74-92e3-643868cdc275 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.706345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8de1df-c061-4a74-92e3-643868cdc275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.738378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 849/1729] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:51.739334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:51.757540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a1027-5e3f-4425-8f1d-3ce38f80b015 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:51.774082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:51.776797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.778160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.778847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] PATH_INFO: `/v3/projects/2af580aee7374f2c8bf292c2fabee5d0/users/a81ad48aec9d400baa7fa217c537bdd6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.789882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4c8de1df-c061-4a74-92e3-643868cdc275 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:51.831669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4c8de1df-c061-4a74-92e3-643868cdc275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:51.831669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 881/1730] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:51.831669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8de1df-c061-4a74-92e3-643868cdc275 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:51.832477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af580aee7374f2c8bf292c2fabee5d0, user_id=a81ad48aec9d400baa7fa217c537bdd6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:51.838632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:51.851827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8de1df-c061-4a74-92e3-643868cdc275 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:51.875415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:51.876306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:51.876885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:51.878565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] PATH_INFO: `/v3/projects/9e839a7ce85f4c9494f976a7ab337b54/users/84ef9e36b88d49b9aea66dc440e19076/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:51.917074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e839a7ce85f4c9494f976a7ab337b54, user_id=84ef9e36b88d49b9aea66dc440e19076, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:51.924747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:52.071127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 850/1731] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:51 2022] PUT /identity/v3/projects/2af580aee7374f2c8bf292c2fabee5d0/users/a81ad48aec9d400baa7fa217c537bdd6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:52.076529 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:52.133912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 882/1732] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:51 2022] PUT /identity/v3/projects/9e839a7ce85f4c9494f976a7ab337b54/users/84ef9e36b88d49b9aea66dc440e19076/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:52.134911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:52.417060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ab07-b96e-4d7f-9657-ebc29a663f71 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:52.417869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695e839-2565-40fd-a73b-0fd91e477904 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:52.430219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:52.456583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:52.456873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:52.456873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:52.456873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:52.457071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:52.457071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:52.457071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:52.457266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:52.457338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:52.457338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:52.457338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:52.457524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:52.467397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 883/1733] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:52.468452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:52.489944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0ff2-8f34-4f55-8db8-fac18a655c90 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:52.493812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 851/1734] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:52.502982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:52.503694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:52.503919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:52.504033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:52.504655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:52.505566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:52.507266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:52.535757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 884/1735] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:52.538880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:52.552906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e407f8b-9f64-4937-b5da-b45619855775 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:52.565093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ed5ba-a8d4-4986-bc62-c8b0605f132f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:52.579538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb710a5b-d163-4f8a-ac52-4a3735841f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:52.580180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710a5b-d163-4f8a-ac52-4a3735841f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:52.580342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710a5b-d163-4f8a-ac52-4a3735841f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:52.580665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb710a5b-d163-4f8a-ac52-4a3735841f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:52.581738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb710a5b-d163-4f8a-ac52-4a3735841f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:52.592325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb710a5b-d163-4f8a-ac52-4a3735841f79 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:52.612589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:52.625733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:52.625733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:52.625733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] PATH_INFO: `/v3/projects/2af580aee7374f2c8bf292c2fabee5d0/users/a81ad48aec9d400baa7fa217c537bdd6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:52.634360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af580aee7374f2c8bf292c2fabee5d0, user_id=a81ad48aec9d400baa7fa217c537bdd6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:52.644019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:52.674840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 852/1736] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:52 2022] PUT /identity/v3/projects/2af580aee7374f2c8bf292c2fabee5d0/users/a81ad48aec9d400baa7fa217c537bdd6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:52.686853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:52.725541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 885/1737] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:52 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:52.727914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a3a4c-f83a-4850-8906-b1e8671f394d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:52.728434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a3a4c-f83a-4850-8906-b1e8671f394d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:52.729890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a3a4c-f83a-4850-8906-b1e8671f394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:52.808048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90745813-37c6-4ce8-9b4d-5a47be92de16 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:52.875121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-802a3a4c-f83a-4850-8906-b1e8671f394d None None] MFA Rules not processed for user `a81ad48aec9d400baa7fa217c537bdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:52.876831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-802a3a4c-f83a-4850-8906-b1e8671f394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:52.956350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:52.961224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:52.961610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:52.962221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] PATH_INFO: `/v3/projects/9e839a7ce85f4c9494f976a7ab337b54/users/84ef9e36b88d49b9aea66dc440e19076/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:52.978291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e839a7ce85f4c9494f976a7ab337b54, user_id=84ef9e36b88d49b9aea66dc440e19076, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:52.994739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:53.061624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 853/1738] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:52 2022] PUT /identity/v3/projects/9e839a7ce85f4c9494f976a7ab337b54/users/84ef9e36b88d49b9aea66dc440e19076/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:53.063415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:53.365243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 886/1739] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 639 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:53.378877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fbedb-708e-4a63-a7f5-24bf2787f9ad None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:53.378877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fbedb-708e-4a63-a7f5-24bf2787f9ad None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:53.378877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fbedb-708e-4a63-a7f5-24bf2787f9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:53.459499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d50fbedb-708e-4a63-a7f5-24bf2787f9ad None None] MFA Rules not processed for user `442a196ea29942b682a170dc9b7ef607`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:53.460913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d50fbedb-708e-4a63-a7f5-24bf2787f9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:53.462293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14179163-345f-46e8-8189-3b2f62e7eba5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:53.477679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:53.482069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:53.482069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:53.482069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:53.482069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:53.492326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:53.639288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 887/1740] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:53.640661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975e36-55aa-4f8f-9ddf-763e7d73c98c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:53.641003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975e36-55aa-4f8f-9ddf-763e7d73c98c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:53.641271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03975e36-55aa-4f8f-9ddf-763e7d73c98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:53.699918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 854/1741] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:53 2022] POST /identity/v3/users => generated 286 bytes in 638 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:53.746448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:53.746448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:53.747787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-03975e36-55aa-4f8f-9ddf-763e7d73c98c None None] MFA Rules not processed for user `84ef9e36b88d49b9aea66dc440e19076`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:53.747787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-03975e36-55aa-4f8f-9ddf-763e7d73c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:53.911328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f356fe5-bea1-4b6a-b2a3-387e59b3861c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:53.936928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:53.939124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:53.939758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:53.941701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.016860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 888/1742] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:54.016860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e72d53-e143-44ad-abae-8740e103d766 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:54.016860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e72d53-e143-44ad-abae-8740e103d766 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:54.016860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e72d53-e143-44ad-abae-8740e103d766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.085080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-00e72d53-e143-44ad-abae-8740e103d766 None None] MFA Rules not processed for user `5c06385b20074363b3a5f7216947280b`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:54.086197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-00e72d53-e143-44ad-abae-8740e103d766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:54.095318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:54.098770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:54.110688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:54.119020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 855/1743] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:54.120842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:54.146997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d606d3f-6467-4c7f-84d9-7d0a84bb7f37 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:54.159592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:54.160384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:54.160766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:54.161164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.161924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:54.165242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:54.194941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 856/1744] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:54.197133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:54.202090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:54.216051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 889/1745] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Sep 26 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:54.221698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e72d53-e143-44ad-abae-8740e103d766 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:54.227249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de566c-2341-4440-9072-96eb9c8e1d28 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:54.241661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:54.247126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:54.247322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:54.247729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.253681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e72d53-e143-44ad-abae-8740e103d766 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:54.267059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:54.267889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:54.268273 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:54.268653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.269607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:54.271387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:54.273359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:54.274934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:54.298261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 857/1746] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:54.313580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 890/1747] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:54.314535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:54.317978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:54.327904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:54.384635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af0dca-030f-4c38-8e65-544e749d49b7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:54.402490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:54.403229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745687d-3885-4d17-9fbd-8a55ceb4034e service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:54.404263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:54.404549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:54.404825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] PATH_INFO: `/v3/projects/67b14b06488141f3b9e134fcdce375c0/users/a09d0b7bb4874bcca167007ca6b3b9a4/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.422564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc560ff-2917-4425-bbff-a00452ab04de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:54.423156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc560ff-2917-4425-bbff-a00452ab04de service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:54.423469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc560ff-2917-4425-bbff-a00452ab04de service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:54.423752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc560ff-2917-4425-bbff-a00452ab04de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.446852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc560ff-2917-4425-bbff-a00452ab04de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:54.450438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc560ff-2917-4425-bbff-a00452ab04de service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:54.462976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b14b06488141f3b9e134fcdce375c0, user_id=a09d0b7bb4874bcca167007ca6b3b9a4, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:54.465836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:54.492368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 858/1748] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:54.523153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:54.782164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 891/1749] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:54 2022] PUT /identity/v3/projects/67b14b06488141f3b9e134fcdce375c0/users/a09d0b7bb4874bcca167007ca6b3b9a4/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:54.785499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111409e-100d-4c6d-b41f-f395d0f4d9ed None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:54.786152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111409e-100d-4c6d-b41f-f395d0f4d9ed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:54.786650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111409e-100d-4c6d-b41f-f395d0f4d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:54.837858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1111409e-100d-4c6d-b41f-f395d0f4d9ed None None] MFA Rules not processed for user `a09d0b7bb4874bcca167007ca6b3b9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:54.839563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1111409e-100d-4c6d-b41f-f395d0f4d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:55.112601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 859/1750] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:34:55.113767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:55.408022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfac150-97bd-442e-8aa5-8e6c589e19e3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:55.408022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:55.408022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:55.408022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:55.409914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:55.409914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:55.409914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:55.649671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 892/1751] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:55 2022] POST /identity/v3/projects => generated 371 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:55.650901 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111409e-100d-4c6d-b41f-f395d0f4d9ed None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:55.669470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111409e-100d-4c6d-b41f-f395d0f4d9ed None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:56.053457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:56.072858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:56.073460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:56.073949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:56.075959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:56.101549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:56.382332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 860/1752] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:34:55 2022] POST /identity/v3/users => generated 292 bytes in 732 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:56.387443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:56.443694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b70260-9b59-49fe-b96a-3f627f1b4508 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:56.473857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:56.479713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:56.481332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:56.482548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:56.483314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:56.488570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:56.550101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 893/1753] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:34:56.554320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:56.589063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206921bb-cbc6-4ffc-a26c-1cad4378d79c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:56.593019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:56.623465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:56.626058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:56.626348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:56.627375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] PATH_INFO: `/v3/projects/d2d1b096a3a74dc4a6f8af7e257c2b44/users/37f95ed2471f43069011afbd4b6dd865/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:56.685569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d1b096a3a74dc4a6f8af7e257c2b44, user_id=37f95ed2471f43069011afbd4b6dd865, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:56.704801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:57.028471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 861/1754] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:56 2022] PUT /identity/v3/projects/d2d1b096a3a74dc4a6f8af7e257c2b44/users/37f95ed2471f43069011afbd4b6dd865/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:57.032320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:57.055806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b90f6c-5de5-426f-8c85-0ef2a8f2228e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:57.404510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:57.405337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:57.405337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:57.405686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:57.406230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:57.411180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:57.417364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:57.460749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 894/1755] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:34:57.463020 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:57.513703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068d93b-6321-400e-a224-39a371e2a0a8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:57.532702 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854b7c7-c08d-4468-a7c4-80dc55e62a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:57.534409 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b7c7-c08d-4468-a7c4-80dc55e62a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:57.535007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b7c7-c08d-4468-a7c4-80dc55e62a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:57.535640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854b7c7-c08d-4468-a7c4-80dc55e62a62 admin admin] PATH_INFO: `/v3/projects/d2d1b096a3a74dc4a6f8af7e257c2b44/users/37f95ed2471f43069011afbd4b6dd865/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:57.540385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854b7c7-c08d-4468-a7c4-80dc55e62a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d1b096a3a74dc4a6f8af7e257c2b44, user_id=37f95ed2471f43069011afbd4b6dd865, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:57.544135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854b7c7-c08d-4468-a7c4-80dc55e62a62 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:57.590633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e9e34-e7ab-40b7-a78a-a48cbd77fd23 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:57.597124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 895/1756] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:34:57 2022] PUT /identity/v3/projects/d2d1b096a3a74dc4a6f8af7e257c2b44/users/37f95ed2471f43069011afbd4b6dd865/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:34:57.607576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf9c2f-38d9-4533-922f-e6f96f996458 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:57.609004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf9c2f-38d9-4533-922f-e6f96f996458 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:57.609004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf9c2f-38d9-4533-922f-e6f96f996458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:57.699149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f9cf9c2f-38d9-4533-922f-e6f96f996458 None None] MFA Rules not processed for user `37f95ed2471f43069011afbd4b6dd865`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:57.701902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f9cf9c2f-38d9-4533-922f-e6f96f996458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:57.820864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ef9e36b88d49b9aea66dc440e19076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e839a7ce85f4c9494f976a7ab337b54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:57.821938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:57.822425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:57.823017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:57.823898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:57.824360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:57.826950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:57.849525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 862/1757] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:57.854223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:57.876052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b6d3e-9c95-4df0-8ec3-4477515ebffe tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:57.886714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ef9e36b88d49b9aea66dc440e19076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e839a7ce85f4c9494f976a7ab337b54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:57.887732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:57.888189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:57.889316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:57.890327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:57.894607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:57.917215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 896/1758] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:34:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:57.927520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf9c2f-38d9-4533-922f-e6f96f996458 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:58.041249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 863/1759] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:34:57 2022] POST /identity/v3/projects => generated 354 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:34:58.047122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:58.118576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf9c2f-38d9-4533-922f-e6f96f996458 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:58.438335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:58.440181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:58.440863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:58.441852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:58.465422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1678-459c-4252-913b-d03f7f17dda4 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:58.488369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540d55c-b6e0-4913-8e64-62d73b62c9e2 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ef9e36b88d49b9aea66dc440e19076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e839a7ce85f4c9494f976a7ab337b54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:58.488369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540d55c-b6e0-4913-8e64-62d73b62c9e2 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:58.488369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540d55c-b6e0-4913-8e64-62d73b62c9e2 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:58.488618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540d55c-b6e0-4913-8e64-62d73b62c9e2 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:58.488618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540d55c-b6e0-4913-8e64-62d73b62c9e2 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:34:58.488618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540d55c-b6e0-4913-8e64-62d73b62c9e2 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:58.488618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540d55c-b6e0-4913-8e64-62d73b62c9e2 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:58.524884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 864/1760] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:34:58.581723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d58f4-00ed-4e39-9c98-ea623d5e46e7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:58.582377 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d58f4-00ed-4e39-9c98-ea623d5e46e7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:58.583193 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d58f4-00ed-4e39-9c98-ea623d5e46e7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:58.585344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 865/1761] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:34:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:34:58.675458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:58.679384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:58.708938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 897/1762] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:58.841414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d758-edc3-4853-8e52-66a12b077503 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:58.842070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d758-edc3-4853-8e52-66a12b077503 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:58.842499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d758-edc3-4853-8e52-66a12b077503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:58.890082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b6b9d758-edc3-4853-8e52-66a12b077503 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:34:58.890082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b6b9d758-edc3-4853-8e52-66a12b077503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:59.148583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 866/1763] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:34:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:34:59.219934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:59.221820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:34:59.263994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9d758-edc3-4853-8e52-66a12b077503 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:59.284740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f0759-7c36-4237-bf6c-51971adeaf3f service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:59.293744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:59.293744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:59.293744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:59.293744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:59.329792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:59.334159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:59.409815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 898/1764] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:34:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:34:59.414945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:34:59.443528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9d758-edc3-4853-8e52-66a12b077503 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:59.474629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:59.475462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:59.475782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:59.476055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] PATH_INFO: `/v3/users/6bb44de6ae4f4330a44c860d2f7ca2b9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:59.477531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb44de6ae4f4330a44c860d2f7ca2b9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:59.485529 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:59.496428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70289d57-f84d-4ac7-94cc-8033b2612aa0 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:34:59.522720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84ef9e36b88d49b9aea66dc440e19076', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e839a7ce85f4c9494f976a7ab337b54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:34:59.523411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:34:59.523779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:34:59.524172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] PATH_INFO: `/v3/projects/0443eadd0da24f54b2175c8149cbb174` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:34:59.527206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0443eadd0da24f54b2175c8149cbb174)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:34:59.533939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:34:59.581336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:34:59.984554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0443eadd0da24f54b2175c8149cbb174', 'request_id': 'req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.045883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb44de6ae4f4330a44c860d2f7ca2b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.250146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0443eadd0da24f54b2175c8149cbb174', 'request_id': 'req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.263429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0443eadd0da24f54b2175c8149cbb174', 'request_id': 'req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.289652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] The token cache is being invalidate because project 0443eadd0da24f54b2175c8149cbb174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:00.297235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.297235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87602e7f-ff89-4659-b0bc-e18fc7bc2a89 tempest-VolumeQuotaClassesTest-1305399219 tempest-VolumeQuotaClassesTest-1305399219-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.319495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 899/1765] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:34:59 2022] DELETE /identity/v3/projects/0443eadd0da24f54b2175c8149cbb174 => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:00.329635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb44de6ae4f4330a44c860d2f7ca2b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.354936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb44de6ae4f4330a44c860d2f7ca2b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.354936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb44de6ae4f4330a44c860d2f7ca2b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.392192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5bce279a-97e6-4f65-9454-51dce9aeb240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb44de6ae4f4330a44c860d2f7ca2b9'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:00.411606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 867/1766] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:34:59 2022] DELETE /identity/v3/users/6bb44de6ae4f4330a44c860d2f7ca2b9 => generated 0 bytes in 1149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:00.415894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875ae2f-5ba5-459c-a857-262285132e9b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:00.416184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875ae2f-5ba5-459c-a857-262285132e9b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:00.416467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875ae2f-5ba5-459c-a857-262285132e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:00.479032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e875ae2f-5ba5-459c-a857-262285132e9b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:00.480611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e875ae2f-5ba5-459c-a857-262285132e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:00.621615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100d56-62ad-4ef4-9b01-c3b2f9f013b3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:00.622509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100d56-62ad-4ef4-9b01-c3b2f9f013b3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:00.623670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100d56-62ad-4ef4-9b01-c3b2f9f013b3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:00.633523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 868/1767] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:35:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:35:00.696705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 900/1768] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:00.700734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca100d56-62ad-4ef4-9b01-c3b2f9f013b3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:00.702795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ca100d56-62ad-4ef4-9b01-c3b2f9f013b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:00.716045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:00.716045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:00.716255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:00.771223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:00.773067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:00.861132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca100d56-62ad-4ef4-9b01-c3b2f9f013b3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:00.882486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:00.883181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:00.883490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:00.883798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:00.927820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:00.929337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:00.967816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 869/1769] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:00.990369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 901/1770] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:01.026526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:01.029074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:01.060932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abd17b-35fd-4f0d-ae3a-c645d511900d service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:01.090212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:01.100687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:01.100687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:01.100687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:01.113691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:01.115406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:01.145367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 870/1771] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:01.897852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:01.905842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:01.945135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9e626-3ed9-4ea9-8c2d-869d73f58dc1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:01.970289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:01.971484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:01.972114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:01.972567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] PATH_INFO: `/v3/users/0a4e0afb010847ef8f958228ca8d61f6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:01.981812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4e0afb010847ef8f958228ca8d61f6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:01.986940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:02.109893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:02.110789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:02.181057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c87aae-cb35-4b55-9d38-0ebf1bb33ebe service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:02.200530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:02.202676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:02.203261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:02.204170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] PATH_INFO: `/v3/users/a09d0b7bb4874bcca167007ca6b3b9a4` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:02.206083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09d0b7bb4874bcca167007ca6b3b9a4)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:02.215207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:02.638371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:02.671967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4e0afb010847ef8f958228ca8d61f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:02.673165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4e0afb010847ef8f958228ca8d61f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:02.704228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4e0afb010847ef8f958228ca8d61f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:02.732610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09d0b7bb4874bcca167007ca6b3b9a4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:02.783617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4e0afb010847ef8f958228ca8d61f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:03.178639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09d0b7bb4874bcca167007ca6b3b9a4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:03.369898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09d0b7bb4874bcca167007ca6b3b9a4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:03.369898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09d0b7bb4874bcca167007ca6b3b9a4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:03.369898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09d0b7bb4874bcca167007ca6b3b9a4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:03.369898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 871/1772] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:02 2022] DELETE /identity/v3/users/a09d0b7bb4874bcca167007ca6b3b9a4 => generated 0 bytes in 1180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:03.369898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:03.370638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:03.487908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e5483-067c-4796-a943-d48dde2eb10a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:03.498165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:03.499283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:03.499857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:03.500348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] PATH_INFO: `/v3/projects/5e9b93a7fac44296ad1752e035922766` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:03.502349 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9b93a7fac44296ad1752e035922766)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:03.507734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:03.524770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf233cd2-7dde-4931-bd26-0c843c5324b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4e0afb010847ef8f958228ca8d61f6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:03.551466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 902/1773] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:01 2022] DELETE /identity/v3/users/0a4e0afb010847ef8f958228ca8d61f6 => generated 0 bytes in 1642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:03.553968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e50cc-1d38-4f2f-a9d3-96605a3fcfa2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:03.555001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e50cc-1d38-4f2f-a9d3-96605a3fcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:03.555562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e50cc-1d38-4f2f-a9d3-96605a3fcfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:03.600543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bc5e50cc-1d38-4f2f-a9d3-96605a3fcfa2 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:03.601974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bc5e50cc-1d38-4f2f-a9d3-96605a3fcfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:03.756478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 903/1774] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:03.758280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:03.758674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:03.759057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:03.782614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:03.785304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:03.809472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 904/1775] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:03.814908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:03.814908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:03.900114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da5143-f1bd-419f-b69b-89f0d9a8f2b3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:03.906333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:03.906974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:03.907475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:03.921088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:03.942074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:03.944336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:03.969782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 905/1776] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:03.973866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:03.977888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:04.004280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0dae-e3d8-47fe-91f9-c6954c8256d4 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:04.019976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:04.020799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:04.021492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:04.021887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:04.047302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:04.050284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:04.062698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 906/1777] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:04.074124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9b93a7fac44296ad1752e035922766', 'request_id': 'req-1350ffc5-13b3-4185-a133-658cc5da99db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.197900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9b93a7fac44296ad1752e035922766', 'request_id': 'req-1350ffc5-13b3-4185-a133-658cc5da99db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.206714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9b93a7fac44296ad1752e035922766', 'request_id': 'req-1350ffc5-13b3-4185-a133-658cc5da99db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.222859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] The token cache is being invalidate because project 5e9b93a7fac44296ad1752e035922766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:04.223158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.223862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.226019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 872/1778] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:03 2022] DELETE /identity/v3/projects/5e9b93a7fac44296ad1752e035922766 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:04.229956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:04.242369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a63e-4c17-4389-8e24-9059af5e9804 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:04.384317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:04.384317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:04.384317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:04.384317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] PATH_INFO: `/v3/users/a81ad48aec9d400baa7fa217c537bdd6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:04.386027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81ad48aec9d400baa7fa217c537bdd6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:04.390552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:04.838309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:04.909635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81ad48aec9d400baa7fa217c537bdd6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.911834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81ad48aec9d400baa7fa217c537bdd6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.930373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81ad48aec9d400baa7fa217c537bdd6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.945762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81ad48aec9d400baa7fa217c537bdd6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:04.960085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:04.961612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:05.009176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350ffc5-13b3-4185-a133-658cc5da99db admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:05.016704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:05.019462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:05.019776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:05.020054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] PATH_INFO: `/v3/projects/67b14b06488141f3b9e134fcdce375c0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:05.021818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b14b06488141f3b9e134fcdce375c0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:05.026927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:05.093713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81ad48aec9d400baa7fa217c537bdd6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.104300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 907/1779] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:04 2022] DELETE /identity/v3/users/a81ad48aec9d400baa7fa217c537bdd6 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:05.104300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:05.104582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:05.213154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920645-f18a-421c-8d54-d8edba3ba4ea admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:05.228280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b14b06488141f3b9e134fcdce375c0', 'request_id': 'req-f3e36822-d9fe-42aa-9f37-484093968237'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.285461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:05.286115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:05.286515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:05.286806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] PATH_INFO: `/v3/projects/69343df3c0a74e48a300ed803e0fabd6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:05.287966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69343df3c0a74e48a300ed803e0fabd6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:05.290706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:05.372861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b14b06488141f3b9e134fcdce375c0', 'request_id': 'req-f3e36822-d9fe-42aa-9f37-484093968237'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.382892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b14b06488141f3b9e134fcdce375c0', 'request_id': 'req-f3e36822-d9fe-42aa-9f37-484093968237'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.392102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] The token cache is being invalidate because project 67b14b06488141f3b9e134fcdce375c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:05.392421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.393156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.394694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 873/1780] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:04 2022] DELETE /identity/v3/projects/67b14b06488141f3b9e134fcdce375c0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:05.398426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:05.399765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:05.413104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e36822-d9fe-42aa-9f37-484093968237 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:05.417855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:05.418517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:05.418828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:05.419104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] PATH_INFO: `/v3/users/37f95ed2471f43069011afbd4b6dd865` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:05.420284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f95ed2471f43069011afbd4b6dd865)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:05.428702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:05.523680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69343df3c0a74e48a300ed803e0fabd6', 'request_id': 'req-1819959c-a080-49fc-b966-ce393c0659b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.700589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69343df3c0a74e48a300ed803e0fabd6', 'request_id': 'req-1819959c-a080-49fc-b966-ce393c0659b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.708473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69343df3c0a74e48a300ed803e0fabd6', 'request_id': 'req-1819959c-a080-49fc-b966-ce393c0659b0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.718699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f95ed2471f43069011afbd4b6dd865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.723061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] The token cache is being invalidate because project 69343df3c0a74e48a300ed803e0fabd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:05.723394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.724148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.725764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 908/1781] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:05 2022] DELETE /identity/v3/projects/69343df3c0a74e48a300ed803e0fabd6 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:05.729804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:05.731174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:05.802682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819959c-a080-49fc-b966-ce393c0659b0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:05.808809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:05.809135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:05.809371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:05.809992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] PATH_INFO: `/v3/users/84ef9e36b88d49b9aea66dc440e19076` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:05.811427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ef9e36b88d49b9aea66dc440e19076)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:05.817955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:05.847926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f95ed2471f43069011afbd4b6dd865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.864857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f95ed2471f43069011afbd4b6dd865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.865778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f95ed2471f43069011afbd4b6dd865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.873872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f95ed2471f43069011afbd4b6dd865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:05.880136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 874/1782] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:05 2022] DELETE /identity/v3/users/37f95ed2471f43069011afbd4b6dd865 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:05.880940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:05.882297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:05.958096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb8fb8-74b7-4c6b-8143-a1b5ed6253be admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:05.970161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:05.971931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:05.972278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:05.972465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] PATH_INFO: `/v3/projects/2af580aee7374f2c8bf292c2fabee5d0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:05.973822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af580aee7374f2c8bf292c2fabee5d0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:05.976038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:06.155627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ef9e36b88d49b9aea66dc440e19076'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.156430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af580aee7374f2c8bf292c2fabee5d0', 'request_id': 'req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.156576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ef9e36b88d49b9aea66dc440e19076'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.166109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ef9e36b88d49b9aea66dc440e19076'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.181068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ef9e36b88d49b9aea66dc440e19076'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.306635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af580aee7374f2c8bf292c2fabee5d0', 'request_id': 'req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.313703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af580aee7374f2c8bf292c2fabee5d0', 'request_id': 'req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.325779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] The token cache is being invalidate because project 2af580aee7374f2c8bf292c2fabee5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:06.326072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.326754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-42a55cd1-9ed2-4787-9ab4-355dfd3b6172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.328370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 875/1783] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:05 2022] DELETE /identity/v3/projects/2af580aee7374f2c8bf292c2fabee5d0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:06.334238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:06.334586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:06.338504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:06.357033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:06.358380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:06.437825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-049c5dcc-a407-4fa8-a633-2bb4e06f802c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ef9e36b88d49b9aea66dc440e19076'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.441571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 876/1784] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:06.447401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:06.447401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:06.448079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 909/1785] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:05 2022] DELETE /identity/v3/users/84ef9e36b88d49b9aea66dc440e19076 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:06.455098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de6fa-ae81-431c-91c7-cd9bf34b050a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:06.455564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de6fa-ae81-431c-91c7-cd9bf34b050a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:06.459468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab440f-96b9-42d9-adcb-5242a28b8003 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:06.459836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de6fa-ae81-431c-91c7-cd9bf34b050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:06.489550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4d7de6fa-ae81-431c-91c7-cd9bf34b050a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:06.490955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4d7de6fa-ae81-431c-91c7-cd9bf34b050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:06.532479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:06.533125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:06.533415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:06.533691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] PATH_INFO: `/v3/projects/d2d1b096a3a74dc4a6f8af7e257c2b44` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:06.535245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d1b096a3a74dc4a6f8af7e257c2b44)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:06.537274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:06.565071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 910/1786] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:06.569467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7de6fa-ae81-431c-91c7-cd9bf34b050a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:06.578622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7de6fa-ae81-431c-91c7-cd9bf34b050a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:06.583550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:06.584161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:06.585088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:06.585382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:06.586054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:06.586359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:06.587994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:06.601921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 911/1787] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:35:06.611895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:06.622427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad79d75-eda7-47b6-b217-899d668a7f61 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:06.627690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:06.628295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:06.628570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:06.628842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:06.629507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:06.631430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:06.718452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d1b096a3a74dc4a6f8af7e257c2b44', 'request_id': 'req-046b0897-af76-4281-9a41-af1dbbd08916'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.913189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d1b096a3a74dc4a6f8af7e257c2b44', 'request_id': 'req-046b0897-af76-4281-9a41-af1dbbd08916'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.919380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 912/1788] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:06.920964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:06.922631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d1b096a3a74dc4a6f8af7e257c2b44', 'request_id': 'req-046b0897-af76-4281-9a41-af1dbbd08916'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.936385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] The token cache is being invalidate because project d2d1b096a3a74dc4a6f8af7e257c2b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:06.945887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.945887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-046b0897-af76-4281-9a41-af1dbbd08916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:06.945887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 877/1789] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:06 2022] DELETE /identity/v3/projects/d2d1b096a3a74dc4a6f8af7e257c2b44 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:06.950965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:06.951307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:06.951587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:06.973439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:06.975310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.031625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a7cc1-c1d8-4c3a-8ac4-9b2ba8e103ef admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.031625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddc9ee-d90b-4f71-8d67-d7b1db2afa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.031625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc9ee-d90b-4f71-8d67-d7b1db2afa2e admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.031625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc9ee-d90b-4f71-8d67-d7b1db2afa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.031973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddc9ee-d90b-4f71-8d67-d7b1db2afa2e admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.032553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc9ee-d90b-4f71-8d67-d7b1db2afa2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.036885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddc9ee-d90b-4f71-8d67-d7b1db2afa2e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.062821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 878/1790] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:07.063883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.071901 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.097196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30201f7-337c-40a5-824c-e1d78f10c538 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.107227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.107980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.108598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.108893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] PATH_INFO: `/v3/projects/9e839a7ce85f4c9494f976a7ab337b54` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.111301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e839a7ce85f4c9494f976a7ab337b54)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.114168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.167937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:07.174904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 913/1791] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:06 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:07.176564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.176852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.177129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.201004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:07.202237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.210908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 914/1792] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:07.211903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.216077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.229065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc193ad-1e5f-4298-8dfa-cc13d65507d7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.233997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.234633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.234972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.235401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.236841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.238665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.271328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 915/1793] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:07.271328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.271328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490098d-b59a-4f97-ac95-614637e9d000 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.272822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e839a7ce85f4c9494f976a7ab337b54', 'request_id': 'req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:07.353438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.354043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.354506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.355058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.356093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:07.356583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.358232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.378347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 916/1794] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:07.380134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.392785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c4ff2-0600-42f8-a98c-d860ef09c114 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.405037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.405679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.405963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.406235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.406897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.410504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.428149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 917/1795] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:07.429044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.440262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b60c-160c-40eb-b106-8c3c312ea96d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.442889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e839a7ce85f4c9494f976a7ab337b54', 'request_id': 'req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:07.451042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e839a7ce85f4c9494f976a7ab337b54', 'request_id': 'req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:07.460331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01972d6d-7819-479a-a582-ca30cc98115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.460960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01972d6d-7819-479a-a582-ca30cc98115a admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.461238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01972d6d-7819-479a-a582-ca30cc98115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.461744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01972d6d-7819-479a-a582-ca30cc98115a admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.462603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01972d6d-7819-479a-a582-ca30cc98115a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.466982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01972d6d-7819-479a-a582-ca30cc98115a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.482914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] The token cache is being invalidate because project 9e839a7ce85f4c9494f976a7ab337b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:07.482914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:07.482914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:07.484718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 879/1796] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:07 2022] DELETE /identity/v3/projects/9e839a7ce85f4c9494f976a7ab337b54 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:07.486766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.491270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.513620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7209b-103a-4d9f-a3a7-5eab56c23ce0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.520425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.522159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.522975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.523848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] PATH_INFO: `/v3/projects/738cb43fcdcc43afa627bcd9213a8e41/users/14056c32c4c8455f8037641e08288941/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.546373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] RBAC: Authorizing `identity:create_grant(project_id=738cb43fcdcc43afa627bcd9213a8e41, user_id=14056c32c4c8455f8037641e08288941, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.550498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.642025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 918/1797] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:07 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:07.642025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2b8b-c71d-4c05-b5b8-b1f1968d7472 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.642025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2b8b-c71d-4c05-b5b8-b1f1968d7472 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.642025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2b8b-c71d-4c05-b5b8-b1f1968d7472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.666004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-474e2b8b-c71d-4c05-b5b8-b1f1968d7472 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:07.667577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-474e2b8b-c71d-4c05-b5b8-b1f1968d7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.678366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 880/1798] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:07 2022] PUT /identity/v3/projects/738cb43fcdcc43afa627bcd9213a8e41/users/14056c32c4c8455f8037641e08288941/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:07.679321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.687509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.771433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 919/1799] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:07.773499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0278-9b2f-44db-9ccc-398791819807 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.773889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4c0c-a0a6-47c9-a03e-17e1337f393b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.774013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0278-9b2f-44db-9ccc-398791819807 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.774204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0278-9b2f-44db-9ccc-398791819807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.788072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.788744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.789025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.789300 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.790087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.792122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.807897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3fce0278-9b2f-44db-9ccc-398791819807 None None] MFA Rules not processed for user `14056c32c4c8455f8037641e08288941`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:07.809108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3fce0278-9b2f-44db-9ccc-398791819807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.886633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 920/1800] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:07.888621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96d50-80f7-4a3f-9020-db2dd4e7956f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.889394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96d50-80f7-4a3f-9020-db2dd4e7956f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.889884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96d50-80f7-4a3f-9020-db2dd4e7956f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.914192 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-67a96d50-80f7-4a3f-9020-db2dd4e7956f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:07.915461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-67a96d50-80f7-4a3f-9020-db2dd4e7956f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:07.934333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 921/1801] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:07.934333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a96d50-80f7-4a3f-9020-db2dd4e7956f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.941019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 881/1802] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:07 2022] POST /identity/v3/users => generated 283 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:07.943826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.946674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a96d50-80f7-4a3f-9020-db2dd4e7956f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.954222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cac149-0da6-491f-838a-3e3ddd3a5ca5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:07.958286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.959153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.959555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.959801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.960449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.961306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:07.962034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:07.962297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:07.962724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:07.962886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.963531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:07.963904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:07.966401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:07.984533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 882/1803] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:07.985645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:07.996910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72b0b-cfe3-416f-9563-e6c905f05af9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.002775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.003433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.003823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.003989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.004635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.006253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.018219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 883/1804] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:08.019440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.030231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de56dfc-2ce5-4cf7-a4d3-30c93e5db2ca admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.036048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.036606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.036885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.037159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.037792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.039737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.082628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 922/1805] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:07 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:08.082628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.161125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d86b99-5d1d-4f6f-9411-5a422725b1cf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.166527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.167207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.167726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.168022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.168881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.170359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.187279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 923/1806] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:08.206274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.206617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 884/1807] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:08 2022] POST /identity/v3/projects => generated 407 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:08.206711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815016c1-78a4-488d-8514-c93d2aa8fab2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.210061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.263199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.263881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.264165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.264593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.265241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.267741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.285516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6259-1cd0-431c-9eb4-ab76e742ed32 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.308456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.308456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.308456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.308456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] PATH_INFO: `/v3/projects/7e0694beefef49b7a16ed17249325016/users/885341c31dc74ea1b3f5d9bd5801f004/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.325458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0694beefef49b7a16ed17249325016, user_id=885341c31dc74ea1b3f5d9bd5801f004, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.328427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.417281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 924/1808] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:08 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:08.418207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.430323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a690902-f3e1-4bf5-bf52-7140f80e7902 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.436394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.437173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.437622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.437892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.438791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.440944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.461004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 885/1809] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:08 2022] PUT /identity/v3/projects/7e0694beefef49b7a16ed17249325016/users/885341c31dc74ea1b3f5d9bd5801f004/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:08.461912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.604885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b385446-1079-4a32-9073-cadb6f19c82e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.604885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705eb2a-a18c-46cc-8043-273e3dd4d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.604885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705eb2a-a18c-46cc-8043-273e3dd4d32a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.604885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705eb2a-a18c-46cc-8043-273e3dd4d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.605751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705eb2a-a18c-46cc-8043-273e3dd4d32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.605751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705eb2a-a18c-46cc-8043-273e3dd4d32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.605751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705eb2a-a18c-46cc-8043-273e3dd4d32a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.605751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 886/1810] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:08.605751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5b69-dc07-422a-8573-774ba92ec6fa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.605751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5b69-dc07-422a-8573-774ba92ec6fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.606185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c5b69-dc07-422a-8573-774ba92ec6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.614882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2e8c5b69-dc07-422a-8573-774ba92ec6fa None None] MFA Rules not processed for user `885341c31dc74ea1b3f5d9bd5801f004`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:08.617549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2e8c5b69-dc07-422a-8573-774ba92ec6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:08.687059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 887/1811] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:08.688002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5b69-dc07-422a-8573-774ba92ec6fa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.700153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c5b69-dc07-422a-8573-774ba92ec6fa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.707224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.707940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.708225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.708530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] PATH_INFO: `/v3/projects/ec9364969c6b4ff9b5afe23ecde12b59/users/2f199d80fca5459db847db122714ec3e/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.726008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9364969c6b4ff9b5afe23ecde12b59, user_id=2f199d80fca5459db847db122714ec3e, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.728643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.830862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 925/1812] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:08 2022] POST /identity/v3/users => generated 304 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:08.833665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.841859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a50f05-4db2-4073-8525-171ff292684b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.846925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.847670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.847979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.848242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.848887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.850881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.882188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 888/1813] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:08 2022] PUT /identity/v3/projects/ec9364969c6b4ff9b5afe23ecde12b59/users/2f199d80fca5459db847db122714ec3e/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:08.888871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.948071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fd75c-0037-4bbe-b22e-e04c117e7cf0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.952907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.953521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.953805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.954077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.954771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.956528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.966885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 889/1814] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:08.967806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:08.977940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc8eff-974c-4508-85a2-e1f65af447e5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:08.982586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:08.983199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:08.983508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:08.983783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:08.984459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:08.986678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:08.997126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 890/1815] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:08.997914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.008477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee53e-50f7-4284-8243-d11b61486589 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.013800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.014457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.014668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.014940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.015599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.017220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.028086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 891/1816] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:09.036056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:09.036188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.037974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 926/1817] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:08 2022] POST /identity/v3/projects => generated 363 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:09.039579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.040822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98278a-976d-4854-a83a-0809fadafaf9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.103484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.104205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.104481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.104754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] PATH_INFO: `/v3/projects/ec9364969c6b4ff9b5afe23ecde12b59/users/2f199d80fca5459db847db122714ec3e/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.106650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9364969c6b4ff9b5afe23ecde12b59, user_id=2f199d80fca5459db847db122714ec3e, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.107858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80c56-9d7b-4597-a662-37b748eca0ec admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.109425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.113332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f3fa2-9753-4edb-99e0-a2523e1771ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.114004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3fa2-9753-4edb-99e0-a2523e1771ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.114384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3fa2-9753-4edb-99e0-a2523e1771ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.114564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f3fa2-9753-4edb-99e0-a2523e1771ae admin admin] PATH_INFO: `/v3/projects/aaa990d86e384849bdac2d8e783cde44/users/aaf768e67a5049f384c5f9563940a28c/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.123954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 892/1818] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:09 2022] PUT /identity/v3/projects/ec9364969c6b4ff9b5afe23ecde12b59/users/2f199d80fca5459db847db122714ec3e/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:09.125012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.136045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f3fa2-9753-4edb-99e0-a2523e1771ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa990d86e384849bdac2d8e783cde44, user_id=aaf768e67a5049f384c5f9563940a28c, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.138715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f3fa2-9753-4edb-99e0-a2523e1771ae admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.200358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219ae9a-79da-44f2-98b3-e806b86aeb98 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.205907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b33bd-49d4-4f3f-bdf0-4fccd060cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.206519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b33bd-49d4-4f3f-bdf0-4fccd060cad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.206795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b33bd-49d4-4f3f-bdf0-4fccd060cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.207199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b33bd-49d4-4f3f-bdf0-4fccd060cad4 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.207919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b33bd-49d4-4f3f-bdf0-4fccd060cad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.209862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b33bd-49d4-4f3f-bdf0-4fccd060cad4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.293931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 927/1819] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:09 2022] PUT /identity/v3/projects/aaa990d86e384849bdac2d8e783cde44/users/aaf768e67a5049f384c5f9563940a28c/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:09.295422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173026ff-5c71-41c7-8b64-c1434beb842b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.295967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173026ff-5c71-41c7-8b64-c1434beb842b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.296349 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173026ff-5c71-41c7-8b64-c1434beb842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.329184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-173026ff-5c71-41c7-8b64-c1434beb842b None None] MFA Rules not processed for user `2f199d80fca5459db847db122714ec3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:09.331052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-173026ff-5c71-41c7-8b64-c1434beb842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:09.371401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 893/1820] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:09 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:09.371401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.371401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.371401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.404233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] MFA Rules not processed for user `aaf768e67a5049f384c5f9563940a28c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:09.405466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:09.418069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 928/1821] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:09.419717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173026ff-5c71-41c7-8b64-c1434beb842b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.492226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 894/1822] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:09 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:09.493789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.495519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:09.523074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173026ff-5c71-41c7-8b64-c1434beb842b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.528492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.528689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.529067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.529360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.530020 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.531675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.546736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 929/1823] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:09.548562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.560211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0ba74-fdc8-4bcf-a97f-18dda01bcefa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.565740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.566391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.566894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.567170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.575237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.575237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.579456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89d58-b1a1-450e-aabe-eeb83c0102b7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.585593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.586559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.587310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.587310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.662404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.664159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.678187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 895/1824] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:09.678187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.689020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a0ce0-011c-4316-9149-45156e6ab7e2 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.694111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.694789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.695071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.695372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] PATH_INFO: `/v3/projects/05f9112a41144b8f8866a69c0a269bc6/users/86543748804d418ca9b48c634d4c827a/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.708711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 930/1825] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:09 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:09.712660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.715238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f9112a41144b8f8866a69c0a269bc6, user_id=86543748804d418ca9b48c634d4c827a, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.717953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.780607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b3d2f-97d8-4b3e-9e01-fa8deeb47fc9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.787169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.788007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.788296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.788601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.789255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.791839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.842268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 896/1826] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:09 2022] PUT /identity/v3/projects/05f9112a41144b8f8866a69c0a269bc6/users/86543748804d418ca9b48c634d4c827a/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:09.846246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.910959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dcd47-605b-4bb9-a416-2e136a1fdbb6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.915604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.916250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.916527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.916795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.917429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.919020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.932984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 897/1827] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:09.935130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 931/1828] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:09 2022] POST /identity/v3/users => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:09.936063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.939526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.947266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd105c4-75b4-4b5e-a2ad-af8f1ba6b373 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.949969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37366-aca2-40fa-b727-0ce873b8f924 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:09.951969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.952628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.952905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.953172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] PATH_INFO: `/v3/projects/05f9112a41144b8f8866a69c0a269bc6/users/86543748804d418ca9b48c634d4c827a/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.955553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49662-563e-4f66-96e3-a7569f9496eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:09.955717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f9112a41144b8f8866a69c0a269bc6, user_id=86543748804d418ca9b48c634d4c827a, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.956247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49662-563e-4f66-96e3-a7569f9496eb admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.956550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49662-563e-4f66-96e3-a7569f9496eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:09.956825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49662-563e-4f66-96e3-a7569f9496eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:09.957507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49662-563e-4f66-96e3-a7569f9496eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:09.958313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.959092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49662-563e-4f66-96e3-a7569f9496eb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:09.971048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 898/1829] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:09 2022] PUT /identity/v3/projects/05f9112a41144b8f8866a69c0a269bc6/users/86543748804d418ca9b48c634d4c827a/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:09.980282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 932/1830] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:09.986216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:09.999426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:09.999540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.000354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:10.046512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] MFA Rules not processed for user `86543748804d418ca9b48c634d4c827a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:10.048476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:10.096928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b5d5b-dab7-4121-8794-b35f05c40170 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:10.102195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:10.103181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:10.103666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.104120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] PATH_INFO: `/v3/projects/b256495a6b524e468cce636a367dbfab/users/fb740dc32327485b8bf372d15f2214c6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:10.123762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b256495a6b524e468cce636a367dbfab, user_id=fb740dc32327485b8bf372d15f2214c6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:10.126997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:10.148514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 933/1831] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:10.164611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:10.166093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:10.230107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16c74c-1ee5-4b71-866b-1c7549b06586 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:10.233050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 899/1832] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:09 2022] PUT /identity/v3/projects/b256495a6b524e468cce636a367dbfab/users/fb740dc32327485b8bf372d15f2214c6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:10.237935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:10.287118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000b135-83d6-4286-9b85-dc7e67325f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:10.287800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b135-83d6-4286-9b85-dc7e67325f09 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:10.288079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b135-83d6-4286-9b85-dc7e67325f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.288348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b135-83d6-4286-9b85-dc7e67325f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:10.307296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c74c18-367d-4146-a399-b1cf99fbba18 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:10.315953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:10.321534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:10.321534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.321534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:10.321534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:10.321534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:10.335859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 900/1833] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:10.344591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:10.357432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab853ae-b9cd-46bb-bd44-15dd43626089 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:10.363565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000b135-83d6-4286-9b85-dc7e67325f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:10.364147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:10.364466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:10.364734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.365010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] PATH_INFO: `/v3/projects/b256495a6b524e468cce636a367dbfab/users/fb740dc32327485b8bf372d15f2214c6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:10.365194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000b135-83d6-4286-9b85-dc7e67325f09 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:10.367253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b256495a6b524e468cce636a367dbfab, user_id=fb740dc32327485b8bf372d15f2214c6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:10.369732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:10.380603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 934/1834] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:10.398685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 901/1835] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:10 2022] PUT /identity/v3/projects/b256495a6b524e468cce636a367dbfab/users/fb740dc32327485b8bf372d15f2214c6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:10.410073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899719-c39b-444d-8def-8362862ada86 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:10.413320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899719-c39b-444d-8def-8362862ada86 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.413320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21899719-c39b-444d-8def-8362862ada86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:10.441334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-21899719-c39b-444d-8def-8362862ada86 None None] MFA Rules not processed for user `fb740dc32327485b8bf372d15f2214c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:10.443138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-21899719-c39b-444d-8def-8362862ada86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:10.618525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 935/1836] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:10 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:10.669144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:10.766926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33784fd9-6a5c-45fd-af60-36c2e9395f52 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:10.772758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:10.773916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:10.774270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.774653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:10.791271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:10.793471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:10.827729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 902/1837] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:10.864823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899719-c39b-444d-8def-8362862ada86 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:10.881210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21899719-c39b-444d-8def-8362862ada86 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:10.887327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f82e7-cb19-41b0-bd25-50f60d01b6b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:10.888535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f82e7-cb19-41b0-bd25-50f60d01b6b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:10.888902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f82e7-cb19-41b0-bd25-50f60d01b6b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:10.889442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f82e7-cb19-41b0-bd25-50f60d01b6b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:11.002254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f82e7-cb19-41b0-bd25-50f60d01b6b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:11.005501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f82e7-cb19-41b0-bd25-50f60d01b6b3 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:11.022721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 936/1838] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:11.099207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:11.663071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:11.675362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035031c-7fe3-4117-aae5-4ea937c3307c service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:11.679336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1c323-0a69-4422-869e-39e29ee62286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:11.680821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c323-0a69-4422-869e-39e29ee62286 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:11.681113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c323-0a69-4422-869e-39e29ee62286 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:11.686422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c323-0a69-4422-869e-39e29ee62286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:11.746569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1c323-0a69-4422-869e-39e29ee62286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:11.748075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1c323-0a69-4422-869e-39e29ee62286 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:11.758049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 903/1839] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:11 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:14.911388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:15.247120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccca94-2b68-49e4-8bbe-48762c1f09be None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:15.249512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccca94-2b68-49e4-8bbe-48762c1f09be None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:15.250944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccca94-2b68-49e4-8bbe-48762c1f09be None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:15.256770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 937/1840] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:35:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:35:15.317655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d8738-fe37-41d8-bc79-be2164f5a50f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:15.319051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d8738-fe37-41d8-bc79-be2164f5a50f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:15.319862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d8738-fe37-41d8-bc79-be2164f5a50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:15.376966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-302d8738-fe37-41d8-bc79-be2164f5a50f None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:15.376966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-302d8738-fe37-41d8-bc79-be2164f5a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:15.438663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:15.495478 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 904/1841] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:15.517625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccca94-2b68-49e4-8bbe-48762c1f09be None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:15.518397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afccca94-2b68-49e4-8bbe-48762c1f09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:15.545594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccca94-2b68-49e4-8bbe-48762c1f09be None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:15.564484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:15.565628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:15.566097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:15.566582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:15.581824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:15.587293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:15.603529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 938/1842] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:15.659228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d8738-fe37-41d8-bc79-be2164f5a50f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:15.672286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d8738-fe37-41d8-bc79-be2164f5a50f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:15.678972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac870-4a73-4986-8896-3d9d3a33de23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:15.679096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac870-4a73-4986-8896-3d9d3a33de23 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:15.679510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac870-4a73-4986-8896-3d9d3a33de23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:15.679843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac870-4a73-4986-8896-3d9d3a33de23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:15.758320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aac870-4a73-4986-8896-3d9d3a33de23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:15.759847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aac870-4a73-4986-8896-3d9d3a33de23 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:15.772026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 905/1843] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:18.163004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:18.713345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:21.445519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:21.540931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:21.557465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a7c2-de3a-4724-a899-f4a002cc9bb9 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:21.571677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:21.572325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:21.573036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:21.573614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] PATH_INFO: `/v3/users/aaf768e67a5049f384c5f9563940a28c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:21.575681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf768e67a5049f384c5f9563940a28c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:21.611506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:22.013390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf768e67a5049f384c5f9563940a28c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:22.014045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf768e67a5049f384c5f9563940a28c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:22.021352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf768e67a5049f384c5f9563940a28c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:22.034297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf768e67a5049f384c5f9563940a28c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:22.075738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:22.152910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf768e67a5049f384c5f9563940a28c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:22.165229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 939/1844] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:21 2022] DELETE /identity/v3/users/aaf768e67a5049f384c5f9563940a28c => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:22.171128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:22.171687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:22.172326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:22.193850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:22.195200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:22.265806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 906/1845] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:22.276012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:22.277530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:22.337651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aad7a-aba5-4159-8bd1-e4ed4ea1a111 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:22.342128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:22.342726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:22.343008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:22.343280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:22.354140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:22.356229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:22.366352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 940/1846] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:22.910603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:22.910603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:22.949478 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fd0fa-5559-4ebe-937d-5f6d9c8f65c4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:22.978006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:22.983227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:22.983227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:22.983227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] PATH_INFO: `/v3/projects/aaa990d86e384849bdac2d8e783cde44` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:22.986778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa990d86e384849bdac2d8e783cde44)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:22.992500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:23.253292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa990d86e384849bdac2d8e783cde44', 'request_id': 'req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.369441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa990d86e384849bdac2d8e783cde44', 'request_id': 'req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.376806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa990d86e384849bdac2d8e783cde44', 'request_id': 'req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.389417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] The token cache is being invalidate because project aaa990d86e384849bdac2d8e783cde44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:23.389630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.390368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.392546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 907/1847] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:22 2022] DELETE /identity/v3/projects/aaa990d86e384849bdac2d8e783cde44 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:23.396913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:23.407638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac68da-7404-4cb6-baab-b52ac9807ce4 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:23.488328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:23.489068 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:23.489427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:23.489938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] PATH_INFO: `/v3/users/fb740dc32327485b8bf372d15f2214c6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:23.491191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb740dc32327485b8bf372d15f2214c6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:23.493554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:23.771837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb740dc32327485b8bf372d15f2214c6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.772937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb740dc32327485b8bf372d15f2214c6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.783260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb740dc32327485b8bf372d15f2214c6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.798641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb740dc32327485b8bf372d15f2214c6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.905142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb740dc32327485b8bf372d15f2214c6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:23.912583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 941/1848] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:23 2022] DELETE /identity/v3/users/fb740dc32327485b8bf372d15f2214c6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:24.456324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:24.458252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:24.496210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3cf13-27cb-4ef9-b477-8e35a2ef7e3d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:24.583168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:24.590080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:24.590080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:24.590080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] PATH_INFO: `/v3/projects/b256495a6b524e468cce636a367dbfab` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:24.590080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b256495a6b524e468cce636a367dbfab)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:24.590685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:24.756123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b256495a6b524e468cce636a367dbfab', 'request_id': 'req-155c2bb7-4a07-4ee1-b018-f0955367e466'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:24.847392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:24.849248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:24.861639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:24.862249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b256495a6b524e468cce636a367dbfab', 'request_id': 'req-155c2bb7-4a07-4ee1-b018-f0955367e466'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:24.866193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1f8e-c6b8-4e3c-9a00-18125a3a280d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:24.879251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b256495a6b524e468cce636a367dbfab', 'request_id': 'req-155c2bb7-4a07-4ee1-b018-f0955367e466'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:24.894326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] The token cache is being invalidate because project b256495a6b524e468cce636a367dbfab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:24.894869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:24.895853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-155c2bb7-4a07-4ee1-b018-f0955367e466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:24.901101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 908/1849] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:24 2022] DELETE /identity/v3/projects/b256495a6b524e468cce636a367dbfab => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:24.902753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5460c-451b-4e49-b0e2-26217c8c134d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:24.903201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5460c-451b-4e49-b0e2-26217c8c134d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:24.903650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5460c-451b-4e49-b0e2-26217c8c134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:24.925488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4aa5460c-451b-4e49-b0e2-26217c8c134d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:24.926826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4aa5460c-451b-4e49-b0e2-26217c8c134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:24.944775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:24.945449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:24.946735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:24.946735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] PATH_INFO: `/v3/users/885341c31dc74ea1b3f5d9bd5801f004` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:24.947709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=885341c31dc74ea1b3f5d9bd5801f004)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:24.949805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:24.996759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 909/1850] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:25.004895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384ee9-8a21-4c94-b3f6-e293cf8bcdac None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.005180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384ee9-8a21-4c94-b3f6-e293cf8bcdac None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.005468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384ee9-8a21-4c94-b3f6-e293cf8bcdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.042800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-01384ee9-8a21-4c94-b3f6-e293cf8bcdac None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:25.044211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-01384ee9-8a21-4c94-b3f6-e293cf8bcdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:25.061671 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 910/1851] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:25.074471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384ee9-8a21-4c94-b3f6-e293cf8bcdac None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:25.090259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384ee9-8a21-4c94-b3f6-e293cf8bcdac None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:25.095911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:25.096606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.096890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.097160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.097834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:25.098123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:25.099819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:25.118661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:25.120635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 911/1852] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:25.128719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:25.136651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bccae9-9260-49d9-bafc-c4eb0c1dd130 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:25.144575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:25.145428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.145577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.145805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.146472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:25.148492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:25.253650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885341c31dc74ea1b3f5d9bd5801f004'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:25.254086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885341c31dc74ea1b3f5d9bd5801f004'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:25.263608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885341c31dc74ea1b3f5d9bd5801f004'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:25.276894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885341c31dc74ea1b3f5d9bd5801f004'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:25.323817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 912/1853] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:25 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:25.324904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:25.326764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:25.410920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe8a8e-e679-423d-9290-0b3073eff580 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:25.415811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:25.416510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.416878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.417221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.417964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:25.420070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:25.429175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bd40c56f-7ed9-40f6-be30-6adccd2f5efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885341c31dc74ea1b3f5d9bd5801f004'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:25.435884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 942/1854] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:24 2022] DELETE /identity/v3/users/885341c31dc74ea1b3f5d9bd5801f004 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:25.441854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.442221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.442694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.462419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:25.463709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:25.573262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 943/1855] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:25.581746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:25.583232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:25.594017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 913/1856] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:25 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:25.602025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:25.613765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6611b74-9722-45d6-92d1-8e28b43a6d7f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:25.620461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:25.621276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.621813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.622403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.623224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:25.624901 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:25.639257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 914/1857] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:25.644400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:25.658653 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbec18-3d04-48c8-8c6c-be4e40b3aaa9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:25.674078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:25.674549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.674987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.675547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.676410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:25.678546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:25.695050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 915/1858] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:25.702312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503716-acbd-4f07-9ac5-f78ea03f94f9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:25.705501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:25.723439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02db6a9-317d-4c83-bc7f-f7b37ede7938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:25.724293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02db6a9-317d-4c83-bc7f-f7b37ede7938 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.724748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02db6a9-317d-4c83-bc7f-f7b37ede7938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.725022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02db6a9-317d-4c83-bc7f-f7b37ede7938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.727868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc479-3e36-4179-9dea-6ed70bfc9580 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:25.740127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02db6a9-317d-4c83-bc7f-f7b37ede7938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:25.747917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02db6a9-317d-4c83-bc7f-f7b37ede7938 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:25.758264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:25.759321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:25.759776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:25.760230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] PATH_INFO: `/v3/projects/038616adec924b4d83fa1f9ec116c582/users/b86b2245a7e84cb9b94047346107d863/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:25.778977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 944/1859] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:25.811735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038616adec924b4d83fa1f9ec116c582, user_id=b86b2245a7e84cb9b94047346107d863, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:25.819467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:26.001724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 916/1860] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:25 2022] PUT /identity/v3/projects/038616adec924b4d83fa1f9ec116c582/users/b86b2245a7e84cb9b94047346107d863/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:26.003077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4b26e-9ca1-4897-a9df-b712d38888bf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:26.003648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4b26e-9ca1-4897-a9df-b712d38888bf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:26.003648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4b26e-9ca1-4897-a9df-b712d38888bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:26.037332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5ab4b26e-9ca1-4897-a9df-b712d38888bf None None] MFA Rules not processed for user `b86b2245a7e84cb9b94047346107d863`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:26.042578 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5ab4b26e-9ca1-4897-a9df-b712d38888bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:26.118067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 945/1861] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:26.122513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:26.247155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751b6e4-9668-4574-a8e4-a05af19e2bf5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:26.270382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:26.271019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:26.271409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:26.286697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:26.289861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:26.297014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:26.464908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 917/1862] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:26 2022] POST /identity/v3/projects => generated 379 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:26.466712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4b26e-9ca1-4897-a9df-b712d38888bf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:26.478728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4b26e-9ca1-4897-a9df-b712d38888bf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:26.508267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:26.510191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:26.612469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:26.613507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:26.614502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:26.614963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:26.615854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:26.618285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:26.648857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a88841-28e4-4960-9373-ba98c765e3ed admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:26.656032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:26.656947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:26.658270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:26.658862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] PATH_INFO: `/v3/projects/7e0694beefef49b7a16ed17249325016` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:26.660448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0694beefef49b7a16ed17249325016)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:26.662452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:26.757432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 946/1863] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:26 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:26.758284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:26.772027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239c5c5-b863-4531-b316-cf5cb5b1a0b9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:26.778233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:26.779961 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:26.780393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:26.780997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:26.783204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:26.785212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:26.799295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 947/1864] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:26.807489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:26.819397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccb429-d176-46b4-80be-9c8e4c28ff42 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:26.840022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0694beefef49b7a16ed17249325016', 'request_id': 'req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:26.890439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:26.891060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:26.891364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:26.892343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:26.893063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:26.894691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:26.905504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 948/1865] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:26.910694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:26.922013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6fbda-80f8-4f48-9fd7-a3168f2be0ab admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:26.927552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:26.928228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:26.928508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:26.928783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] PATH_INFO: `/v3/projects/377479e0b43943a6b0314238ba3fcbe1/users/619b13e07be0450cba4835da72d39e92/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:26.945035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=377479e0b43943a6b0314238ba3fcbe1, user_id=619b13e07be0450cba4835da72d39e92, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:26.947715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:27.019702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0694beefef49b7a16ed17249325016', 'request_id': 'req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.031866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0694beefef49b7a16ed17249325016', 'request_id': 'req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.055298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 949/1866] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:26 2022] PUT /identity/v3/projects/377479e0b43943a6b0314238ba3fcbe1/users/619b13e07be0450cba4835da72d39e92/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:27.066735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] The token cache is being invalidate because project 7e0694beefef49b7a16ed17249325016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:27.066735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.066735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7496d64d-c4dc-44a3-a9c5-4f2b35e8d57b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.071321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 918/1867] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:26 2022] DELETE /identity/v3/projects/7e0694beefef49b7a16ed17249325016 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:27.072489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:27.074916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:27.078471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:27.079918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:27.079918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:27.129779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] MFA Rules not processed for user `619b13e07be0450cba4835da72d39e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:27.131040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:27.175986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc2f6-c22a-4302-ac65-055f46765c23 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:27.190954 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:27.191777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:27.192201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:27.192533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] PATH_INFO: `/v3/users/86543748804d418ca9b48c634d4c827a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:27.193805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86543748804d418ca9b48c634d4c827a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:27.195839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:27.211439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 919/1868] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:27.215978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:27.217430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:27.232638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78f7a0-e630-478b-83d3-5cd69dc12e99 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:27.240735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:27.241423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:27.252011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:27.252011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:27.252011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:27.252011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:27.415667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 920/1869] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:27 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:27.418772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86543748804d418ca9b48c634d4c827a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.419647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:27.419795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86543748804d418ca9b48c634d4c827a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.421605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:27.430258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86543748804d418ca9b48c634d4c827a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.444183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86543748804d418ca9b48c634d4c827a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.490801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68532503-5642-448a-ae90-49c8c8e5c5bc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:27.495764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:27.496385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:27.496667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:27.496944 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:27.497603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:27.499535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:27.545873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86543748804d418ca9b48c634d4c827a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:27.552271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 950/1870] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:27 2022] DELETE /identity/v3/users/86543748804d418ca9b48c634d4c827a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:27.586386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:27.593509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 921/1871] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:27 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:27.598614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:27.695308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a5bad-6631-46ef-a438-9ef1067c7bd7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:27.702448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:27.703071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:27.703509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:27.703743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:27.705558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:27.707520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:27.718171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 951/1872] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:27.723889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:27.734741 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0bffc-65f7-4e84-8d02-b9b899ad1d12 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:27.740205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:27.740887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:27.741196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:27.741592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] PATH_INFO: `/v3/projects/3d7ed9aad7e74db495c6f9d939368d9a/users/f080f999ab6e430fa068057469346626/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:27.758276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7ed9aad7e74db495c6f9d939368d9a, user_id=f080f999ab6e430fa068057469346626, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:27.761264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:27.894413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 922/1873] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:27 2022] PUT /identity/v3/projects/3d7ed9aad7e74db495c6f9d939368d9a/users/f080f999ab6e430fa068057469346626/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:27.898722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:27.910032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1b4d-ea13-4723-bed5-5c66e7a8a2fa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:27.972107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:27.972752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:27.973033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:27.973309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:27.973966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:27.975765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:27.986355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 952/1874] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:27.990711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:28.001779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaa398-a28a-466d-85ba-498363a7d63f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:28.006573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632be71-a257-4cf6-8c1b-2e300817a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:28.007235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632be71-a257-4cf6-8c1b-2e300817a0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.007548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632be71-a257-4cf6-8c1b-2e300817a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.007818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632be71-a257-4cf6-8c1b-2e300817a0f4 admin admin] PATH_INFO: `/v3/projects/3d7ed9aad7e74db495c6f9d939368d9a/users/f080f999ab6e430fa068057469346626/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.009784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632be71-a257-4cf6-8c1b-2e300817a0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7ed9aad7e74db495c6f9d939368d9a, user_id=f080f999ab6e430fa068057469346626, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:28.013041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632be71-a257-4cf6-8c1b-2e300817a0f4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:28.023775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:28.025746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.044982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 923/1875] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:27 2022] PUT /identity/v3/projects/3d7ed9aad7e74db495c6f9d939368d9a/users/f080f999ab6e430fa068057469346626/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:28.045205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5cece0-1967-41fc-975c-4de520215aaa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:28.046746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.047033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.047414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.089817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] MFA Rules not processed for user `f080f999ab6e430fa068057469346626`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:28.091362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.117856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:28.118626 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.118913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.119184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] PATH_INFO: `/v3/projects/05f9112a41144b8f8866a69c0a269bc6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.120366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f9112a41144b8f8866a69c0a269bc6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:28.122313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:28.169857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 924/1876] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:28.181906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:28.184270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.241659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e96167-b9b2-45ea-905b-39d10594bb3f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:28.245426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:28.246039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.246318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.246591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.264697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:28.270232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:28.281248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 925/1877] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:28.353070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f9112a41144b8f8866a69c0a269bc6', 'request_id': 'req-770ef8c7-94b9-4361-9510-e3f96d859160'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:28.417791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:28.419270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.431750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f4c5-2cc4-4a43-87c2-179df7e43b36 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:28.482859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f9112a41144b8f8866a69c0a269bc6', 'request_id': 'req-770ef8c7-94b9-4361-9510-e3f96d859160'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:28.490528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f9112a41144b8f8866a69c0a269bc6', 'request_id': 'req-770ef8c7-94b9-4361-9510-e3f96d859160'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:28.497877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:28.498599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.499256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.499455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.503398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.506112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] The token cache is being invalidate because project 05f9112a41144b8f8866a69c0a269bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:28.506358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:28.507011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-770ef8c7-94b9-4361-9510-e3f96d859160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:28.508787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 953/1878] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:28 2022] DELETE /identity/v3/projects/05f9112a41144b8f8866a69c0a269bc6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:28.513912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd4e29-698b-49fe-92f9-394f46e3b836 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.522109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd4e29-698b-49fe-92f9-394f46e3b836 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.522109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd4e29-698b-49fe-92f9-394f46e3b836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.522109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:28.542148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a3fd4e29-698b-49fe-92f9-394f46e3b836 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:28.542914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a3fd4e29-698b-49fe-92f9-394f46e3b836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.609771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 954/1879] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:28.620382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:28.621385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d87274-a8a1-41ca-a932-74b9d0b09eec None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.621876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:28.626433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d87274-a8a1-41ca-a932-74b9d0b09eec None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.626717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d87274-a8a1-41ca-a932-74b9d0b09eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.633566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 926/1880] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:28.655115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-92d87274-a8a1-41ca-a932-74b9d0b09eec None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:28.655115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-92d87274-a8a1-41ca-a932-74b9d0b09eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.664406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 955/1881] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:28.666512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:28.668007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:28.683315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05052a-e78c-4adb-89f4-e29b7bf2bd2c service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:28.696084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:28.696084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.696084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.696084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.696374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:28.696374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:28.696374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:28.709786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 927/1882] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:28.711437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d87274-a8a1-41ca-a932-74b9d0b09eec None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:28.721563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d87274-a8a1-41ca-a932-74b9d0b09eec None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:28.727049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:28.727620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.727982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.728345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.729065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:28.731104 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:28.870566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 956/1883] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:28 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:28.872108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:28.886518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e636c3-73b6-4e14-bf70-1115d8d47481 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:28.960984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:28.961846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:28.962211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:28.962566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:28.963366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:28.965626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:29.077462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 928/1884] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:28 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:29.082180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:29.092756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae51dcb-2f97-4eeb-87bb-41f87837afda admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:29.097697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:29.098305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.098579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.098850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:29.099537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:29.101130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:29.112314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 957/1885] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:29.116326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:29.126874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb01af-4723-4466-bfa4-ee3215d67701 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:29.131802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7fae4-52ce-450b-8ebd-661aabf682b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:29.132412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7fae4-52ce-450b-8ebd-661aabf682b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.132686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7fae4-52ce-450b-8ebd-661aabf682b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.132953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7fae4-52ce-450b-8ebd-661aabf682b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:29.133595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7fae4-52ce-450b-8ebd-661aabf682b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:29.135190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7fae4-52ce-450b-8ebd-661aabf682b8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:29.145940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 929/1886] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:29.150412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:29.160503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee08ad-bdb1-43fe-a447-e805f4f35116 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:29.165196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:29.165865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.166143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.166419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] PATH_INFO: `/v3/projects/d2fecb1541b7432fab1553a4029a1c93/users/f69605c09f07449c9f5ae35db37df7bb/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:29.182523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fecb1541b7432fab1553a4029a1c93, user_id=f69605c09f07449c9f5ae35db37df7bb, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:29.185255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:29.286547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 958/1887] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:29 2022] PUT /identity/v3/projects/d2fecb1541b7432fab1553a4029a1c93/users/f69605c09f07449c9f5ae35db37df7bb/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:29.296576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c9011-90bd-4ab2-9979-fda8e69caf7b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.296868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c9011-90bd-4ab2-9979-fda8e69caf7b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.297143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c9011-90bd-4ab2-9979-fda8e69caf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:29.328743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d69c9011-90bd-4ab2-9979-fda8e69caf7b None None] MFA Rules not processed for user `f69605c09f07449c9f5ae35db37df7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:29.330048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d69c9011-90bd-4ab2-9979-fda8e69caf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:29.412560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 930/1888] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:29.417727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:29.482835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b68d6-39f5-4591-ba65-338a09af78e7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:29.488435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:29.489048 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.489325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.489595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:29.490370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:29.492167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:29.641254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 959/1889] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:29 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:29.642365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c9011-90bd-4ab2-9979-fda8e69caf7b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:29.653501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c9011-90bd-4ab2-9979-fda8e69caf7b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:29.721221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:29.723999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.724293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.724575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:29.725226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:29.727307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:29.934244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 931/1890] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:29 2022] POST /identity/v3/users => generated 299 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:29.938698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:29.950101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23894a89-a4bc-45a5-bdec-4cfffb35245e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:29.956346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:29.959263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.959263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.959263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:29.959263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:29.960185 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:29.972415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 960/1891] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:29.976892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:29.987947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547eedb-12a6-429a-b909-de5566691206 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:29.992665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:29.993514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:29.993822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:29.994101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] PATH_INFO: `/v3/projects/b77f966886cd42308a6bc3a25c8185a6/users/03ee381df39f4431acae30916516173c/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:30.012429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77f966886cd42308a6bc3a25c8185a6, user_id=03ee381df39f4431acae30916516173c, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:30.015519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:30.150592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 932/1892] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:29 2022] PUT /identity/v3/projects/b77f966886cd42308a6bc3a25c8185a6/users/03ee381df39f4431acae30916516173c/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:30.155176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:30.166071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac634-9f6e-4b37-bb51-93210430b2e2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:30.229850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9592-b2f2-4f61-89e4-c0f8590589c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:30.230600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9592-b2f2-4f61-89e4-c0f8590589c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:30.231056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9592-b2f2-4f61-89e4-c0f8590589c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:30.231711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9592-b2f2-4f61-89e4-c0f8590589c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:30.232528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d9592-b2f2-4f61-89e4-c0f8590589c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:30.234164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d9592-b2f2-4f61-89e4-c0f8590589c9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:30.245522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 961/1893] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:30.249967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:30.264255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04361f2-44a0-417a-a38b-9d590fc83717 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:30.272391 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:30.273119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:30.273402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:30.273679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] PATH_INFO: `/v3/projects/b77f966886cd42308a6bc3a25c8185a6/users/03ee381df39f4431acae30916516173c/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:30.275828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77f966886cd42308a6bc3a25c8185a6, user_id=03ee381df39f4431acae30916516173c, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:30.279125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:30.291889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 933/1894] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:30 2022] PUT /identity/v3/projects/b77f966886cd42308a6bc3a25c8185a6/users/03ee381df39f4431acae30916516173c/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:30.311143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5694-0657-4d1c-8256-1dc3e96489c7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:30.311547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5694-0657-4d1c-8256-1dc3e96489c7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:30.311834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e5694-0657-4d1c-8256-1dc3e96489c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:30.343334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b57e5694-0657-4d1c-8256-1dc3e96489c7 None None] MFA Rules not processed for user `03ee381df39f4431acae30916516173c`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:30.344653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b57e5694-0657-4d1c-8256-1dc3e96489c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:30.431040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 962/1895] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:30.443862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:30.445667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:30.518430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4b8a4-4fa1-439d-8889-6b5af879faa5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:30.522272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd37b92-7c4d-4bd5-ad01-925cffa9446d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:30.522943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37b92-7c4d-4bd5-ad01-925cffa9446d service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:30.523226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37b92-7c4d-4bd5-ad01-925cffa9446d service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:30.523533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd37b92-7c4d-4bd5-ad01-925cffa9446d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:30.534688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd37b92-7c4d-4bd5-ad01-925cffa9446d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:30.536154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd37b92-7c4d-4bd5-ad01-925cffa9446d service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:30.545648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 934/1896] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:30.618587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5694-0657-4d1c-8256-1dc3e96489c7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:30.696247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e5694-0657-4d1c-8256-1dc3e96489c7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:30.704041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:30.705107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:30.705564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:30.706126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] PATH_INFO: `/v3/users/f69605c09f07449c9f5ae35db37df7bb` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:30.708253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69605c09f07449c9f5ae35db37df7bb)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:30.711296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:30.987443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:31.019122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69605c09f07449c9f5ae35db37df7bb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:31.019893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69605c09f07449c9f5ae35db37df7bb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:31.032023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69605c09f07449c9f5ae35db37df7bb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:31.060950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69605c09f07449c9f5ae35db37df7bb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:31.180445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69605c09f07449c9f5ae35db37df7bb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:31.194442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 963/1897] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:30 2022] DELETE /identity/v3/users/f69605c09f07449c9f5ae35db37df7bb => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:31.200209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:31.200692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:31.201424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:31.238572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:31.241937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:31.341665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 935/1898] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:31.352723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:31.354289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:31.458653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfb1ca-0e88-40d2-8416-fefe74a303c0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:31.464703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bdce2-2450-4760-b003-437453139756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:31.465351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bdce2-2450-4760-b003-437453139756 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:31.465634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bdce2-2450-4760-b003-437453139756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:31.465919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bdce2-2450-4760-b003-437453139756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:31.487876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bdce2-2450-4760-b003-437453139756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:31.491419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bdce2-2450-4760-b003-437453139756 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:31.514829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 964/1899] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:31.850837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:32.197386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:32.200383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:32.230377 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa07b0-9c14-4ea8-8245-9c7314eb98c7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:32.245659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:32.246681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:32.246972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:32.247254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] PATH_INFO: `/v3/projects/d2fecb1541b7432fab1553a4029a1c93` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:32.249136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fecb1541b7432fab1553a4029a1c93)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:32.252614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:32.402180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fecb1541b7432fab1553a4029a1c93', 'request_id': 'req-279f49f1-a6a5-4f4b-8065-7d95dbd55689'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:32.485327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fecb1541b7432fab1553a4029a1c93', 'request_id': 'req-279f49f1-a6a5-4f4b-8065-7d95dbd55689'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:32.494345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fecb1541b7432fab1553a4029a1c93', 'request_id': 'req-279f49f1-a6a5-4f4b-8065-7d95dbd55689'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:32.518898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] The token cache is being invalidate because project d2fecb1541b7432fab1553a4029a1c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:32.519444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:32.520430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:32.522992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 936/1900] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:32 2022] DELETE /identity/v3/projects/d2fecb1541b7432fab1553a4029a1c93 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:32.528582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bdce2-2450-4760-b003-437453139756 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:32.541558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bdce2-2450-4760-b003-437453139756 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:32.668442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:32.670793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:32.672031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:32.672426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:32.673050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:32.674795 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] PATH_INFO: `/v3/users/03ee381df39f4431acae30916516173c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:32.677004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ee381df39f4431acae30916516173c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:32.679125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:32.692943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f49f1-a6a5-4f4b-8065-7d95dbd55689 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:32.701250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:32.702545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:32.703034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:32.703664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] PATH_INFO: `/v3/users/c36bb346cba0459e90a9b02d5914ad2e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:32.706502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36bb346cba0459e90a9b02d5914ad2e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:32.708872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:32.990916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36bb346cba0459e90a9b02d5914ad2e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:32.997770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ee381df39f4431acae30916516173c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:32.998631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ee381df39f4431acae30916516173c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.008425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ee381df39f4431acae30916516173c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.041778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ee381df39f4431acae30916516173c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.111080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36bb346cba0459e90a9b02d5914ad2e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.148839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36bb346cba0459e90a9b02d5914ad2e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.150327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36bb346cba0459e90a9b02d5914ad2e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.164882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-361355a0-188e-4564-b3ef-23064f8f48ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36bb346cba0459e90a9b02d5914ad2e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.181112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 937/1901] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:32 2022] DELETE /identity/v3/users/c36bb346cba0459e90a9b02d5914ad2e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:33.182762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:33.183129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:33.183498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:33.216799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:33.217430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ee381df39f4431acae30916516173c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:33.217523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:33.234750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 965/1902] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:32 2022] DELETE /identity/v3/users/03ee381df39f4431acae30916516173c => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:33.366118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 938/1903] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:33.426846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:33.433456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:33.548237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e78325-59d7-473b-8c44-dc44f240bb9f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:33.553625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:33.554740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:33.555470 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:33.556004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:33.660337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:33.735671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:33.739952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:33.766908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 966/1904] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:33.773770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=73,keystone:DELETE=24,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:34.271663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:34.280326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:34.317823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d884a0-b36d-4aaa-8625-20c8f3e1dcec None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:34.340315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:34.340315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:34.340315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:34.340315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] PATH_INFO: `/v3/projects/b77f966886cd42308a6bc3a25c8185a6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:34.341191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77f966886cd42308a6bc3a25c8185a6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:34.341191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:34.566892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77f966886cd42308a6bc3a25c8185a6', 'request_id': 'req-060761b7-97bf-4938-a1ad-d0dd652db0a2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:34.634075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:34.637189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:34.661184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3db800-aac4-4588-b7b2-8e0d530b708a service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:34.683528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77f966886cd42308a6bc3a25c8185a6', 'request_id': 'req-060761b7-97bf-4938-a1ad-d0dd652db0a2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:34.696370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77f966886cd42308a6bc3a25c8185a6', 'request_id': 'req-060761b7-97bf-4938-a1ad-d0dd652db0a2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:34.713314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] The token cache is being invalidate because project b77f966886cd42308a6bc3a25c8185a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:34.713887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:34.714966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-060761b7-97bf-4938-a1ad-d0dd652db0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:34.717136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 939/1905] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:34 2022] DELETE /identity/v3/projects/b77f966886cd42308a6bc3a25c8185a6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:34.744247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42afc36-97e1-4c60-98c6-c3e5d5f3f605 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:34.744247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42afc36-97e1-4c60-98c6-c3e5d5f3f605 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:34.744247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42afc36-97e1-4c60-98c6-c3e5d5f3f605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:34.770911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b42afc36-97e1-4c60-98c6-c3e5d5f3f605 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:34.773253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b42afc36-97e1-4c60-98c6-c3e5d5f3f605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:34.799732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:34.801381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:34.802017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:34.802722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] PATH_INFO: `/v3/projects/fbf09803683d4f62b69ec06cd065b2c0` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:34.807261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf09803683d4f62b69ec06cd065b2c0)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:34.809868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:34.912494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 940/1906] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:34.924993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95fc9-9bcf-4b23-be96-fd73d73ecbce None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:34.925714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95fc9-9bcf-4b23-be96-fd73d73ecbce None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:34.926256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b95fc9-9bcf-4b23-be96-fd73d73ecbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:34.959547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-79b95fc9-9bcf-4b23-be96-fd73d73ecbce None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:34.960803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-79b95fc9-9bcf-4b23-be96-fd73d73ecbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:34.986401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 941/1907] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:34.991660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b95fc9-9bcf-4b23-be96-fd73d73ecbce None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:35.008314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b95fc9-9bcf-4b23-be96-fd73d73ecbce None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:35.011407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf09803683d4f62b69ec06cd065b2c0', 'request_id': 'req-b06c0b22-29aa-4f82-acfc-5437cf781c82'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.127469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf09803683d4f62b69ec06cd065b2c0', 'request_id': 'req-b06c0b22-29aa-4f82-acfc-5437cf781c82'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.145988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf09803683d4f62b69ec06cd065b2c0', 'request_id': 'req-b06c0b22-29aa-4f82-acfc-5437cf781c82'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.146176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:35.148543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:35.150476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:35.151001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:35.155302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:35.156138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:35.161253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:35.196147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 942/1908] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:35.201815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:35.208799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] The token cache is being invalidate because project fbf09803683d4f62b69ec06cd065b2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:35.209383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.214329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.228249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7309-07c2-4bf0-ad2c-98bad1fee84e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:35.233142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 967/1909] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:34 2022] DELETE /identity/v3/projects/fbf09803683d4f62b69ec06cd065b2c0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:35.234913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:35.240329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:35.250113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:35.252396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:35.252752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:35.254416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:35.256366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:35.261980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:35.267009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c0b22-29aa-4f82-acfc-5437cf781c82 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:35.277705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:35.279370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:35.280250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:35.281048 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] PATH_INFO: `/v3/users/c8892bcd08944a5aad37a782eea4cae1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:35.286585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8892bcd08944a5aad37a782eea4cae1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:35.293622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:35.408847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 943/1910] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:35 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:35.413585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:35.417245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:35.508322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb56bce-5e3f-4856-b9c1-bb0f521a5bad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:35.513008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:35.513680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:35.513972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:35.514231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:35.514874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:35.517476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:35.621782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 944/1911] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:35 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:35.629032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:35.641456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d6d9-f3b8-4bab-a4af-a4c0352bbd16 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:35.650515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8892bcd08944a5aad37a782eea4cae1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.652045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:35.652238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8892bcd08944a5aad37a782eea4cae1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.652706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:35.652982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:35.663022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:35.663022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:35.663022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:35.671032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 945/1912] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:35.675000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8892bcd08944a5aad37a782eea4cae1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.678367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:35.680559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:35.716909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8892bcd08944a5aad37a782eea4cae1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.739379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc07cd-773d-448a-bdbd-1f3a73353d70 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:35.753563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:35.761099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:35.761099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:35.761099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] PATH_INFO: `/v3/users/b86b2245a7e84cb9b94047346107d863` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:35.761099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86b2245a7e84cb9b94047346107d863)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:35.761099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:35.821535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8892bcd08944a5aad37a782eea4cae1'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:35.835444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 968/1913] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:35 2022] DELETE /identity/v3/users/c8892bcd08944a5aad37a782eea4cae1 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:35.836647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:35.838775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:35.978916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32196341-4759-4101-9773-7246e7dd8d3e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:35.993354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:35.994136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:35.994432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:35.995833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:35.997465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:36.002333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:36.024010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 969/1914] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:36.028471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:36.042751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12740e-9845-49ab-be02-b990df037562 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:36.050862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f19fda-9e3b-43eb-a7e5-6935ba62b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:36.051691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19fda-9e3b-43eb-a7e5-6935ba62b136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:36.051976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19fda-9e3b-43eb-a7e5-6935ba62b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:36.052319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f19fda-9e3b-43eb-a7e5-6935ba62b136 admin admin] PATH_INFO: `/v3/projects/0e7da995a6824d13a03f152dc451a0dc/users/46e8b0f3037748c4bc964162f7ec8577/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:36.114412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86b2245a7e84cb9b94047346107d863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:36.115443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f19fda-9e3b-43eb-a7e5-6935ba62b136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7da995a6824d13a03f152dc451a0dc, user_id=46e8b0f3037748c4bc964162f7ec8577, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:36.118483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f19fda-9e3b-43eb-a7e5-6935ba62b136 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:36.191599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86b2245a7e84cb9b94047346107d863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:36.218869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86b2245a7e84cb9b94047346107d863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:36.221384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86b2245a7e84cb9b94047346107d863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:36.233436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39f33908-77b5-4441-a6cc-2289756212c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86b2245a7e84cb9b94047346107d863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:36.242811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 946/1915] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:35 2022] DELETE /identity/v3/users/b86b2245a7e84cb9b94047346107d863 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:36.253128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:36.253567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:36.253843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:36.274044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 970/1916] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:36 2022] PUT /identity/v3/projects/0e7da995a6824d13a03f152dc451a0dc/users/46e8b0f3037748c4bc964162f7ec8577/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:36.308435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:36.312477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:36.313458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:36.322629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:36.351280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:36.386704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] MFA Rules not processed for user `46e8b0f3037748c4bc964162f7ec8577`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:36.387655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:36.496231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:36.534361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 947/1917] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:36.550898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:36.550898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:36.561880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 971/1918] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:36.586906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:36.592141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:36.610494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c4064-8478-4869-a5d3-a31ff770e779 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:36.619316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:36.620570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:36.621169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:36.621995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:36.623458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:36.627886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:36.702099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86865052-84f5-4a01-804b-cda2171d9b62 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:36.709237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:36.710478 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:36.710981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:36.711528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:36.731946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:36.733781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:36.746321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 948/1919] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:36.748400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:36.749943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:36.770026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d744b1-eaf0-4e04-abb8-eb0c2454f70d service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:36.777032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:36.777708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:36.777981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:36.778255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] PATH_INFO: `/v3/projects/8b35d7a5365d4a45952e9aa9d8e8723e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:36.779517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b35d7a5365d4a45952e9aa9d8e8723e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:36.782249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:36.785577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 972/1920] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:36 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:36.790004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:36.827868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:36.895934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5c723-7ef5-47c7-8b49-09abbf5323bc admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:36.900808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:36.901431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:36.901710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:36.901983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:36.902630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:36.912135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.028593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b35d7a5365d4a45952e9aa9d8e8723e', 'request_id': 'req-b73c645e-bd76-436f-a689-f2085bbd94c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:37.104102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 973/1921] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:36 2022] POST /identity/v3/users => generated 299 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:37.105561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.117050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8a852-c986-4acc-85ef-d72d98161528 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.127906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b35d7a5365d4a45952e9aa9d8e8723e', 'request_id': 'req-b73c645e-bd76-436f-a689-f2085bbd94c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:37.135943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b35d7a5365d4a45952e9aa9d8e8723e', 'request_id': 'req-b73c645e-bd76-436f-a689-f2085bbd94c3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:37.163251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] The token cache is being invalidate because project 8b35d7a5365d4a45952e9aa9d8e8723e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:37.163575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:37.164296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b73c645e-bd76-436f-a689-f2085bbd94c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:37.166847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 949/1922] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:36 2022] DELETE /identity/v3/projects/8b35d7a5365d4a45952e9aa9d8e8723e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:37.170862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23531f7-db71-49ed-bd51-5c21aa3b841a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.171228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23531f7-db71-49ed-bd51-5c21aa3b841a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.173011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23531f7-db71-49ed-bd51-5c21aa3b841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.196675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b23531f7-db71-49ed-bd51-5c21aa3b841a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:37.198057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b23531f7-db71-49ed-bd51-5c21aa3b841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:37.204973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:37.205600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.206063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.206374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.207193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:37.209098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.221969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 974/1923] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:37.227869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.229781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:37.246028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9568111-350c-4647-aea4-81e37b374df2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.252308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:37.253047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.253612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.253953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] PATH_INFO: `/v3/projects/ef18155e2ddb4f33a5e4affb449ca8e1/users/40ac517b6b5842e0a5ac856b2ef4dfb6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.274374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef18155e2ddb4f33a5e4affb449ca8e1, user_id=40ac517b6b5842e0a5ac856b2ef4dfb6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:37.277245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.280865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 950/1924] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:37.289283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccde05-ebf4-4110-aed1-d183ea1a7ab8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.289283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccde05-ebf4-4110-aed1-d183ea1a7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.289596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccde05-ebf4-4110-aed1-d183ea1a7ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.310524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6dccde05-ebf4-4110-aed1-d183ea1a7ab8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:37.311778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6dccde05-ebf4-4110-aed1-d183ea1a7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:37.321112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 951/1925] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:37.325821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccde05-ebf4-4110-aed1-d183ea1a7ab8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.338466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccde05-ebf4-4110-aed1-d183ea1a7ab8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.343594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:37.344294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.345249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.345536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.346191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:37.346499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:37.348212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.363927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 952/1926] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:35:37.369466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.385083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fe287-51df-47ab-9a7d-63ecd50764bb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.392005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:37.392768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.393130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.393532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.394272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:37.396714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.422045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 975/1927] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:37 2022] PUT /identity/v3/projects/ef18155e2ddb4f33a5e4affb449ca8e1/users/40ac517b6b5842e0a5ac856b2ef4dfb6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:37.433100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.543735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 953/1928] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:37 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:37.544559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.547905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:37.558753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7665-dab7-44af-bd31-7e56d16cd26b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.647961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77a582-b7f0-4074-a859-10cab1d96a43 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.649950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:37.650656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.650937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.651206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.651951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:37.653591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.654133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:37.655190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.655686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.656122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] PATH_INFO: `/v3/projects/038616adec924b4d83fa1f9ec116c582` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.657401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=038616adec924b4d83fa1f9ec116c582)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:37.659545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.666154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 976/1929] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:37.666154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.680921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc9bc3-d25f-4128-9b75-2352f906210f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.686378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:37.687096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:37.687281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:37.687719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:37.689050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:37.691137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:37.893825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 977/1930] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:37 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:37.893825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:37.918222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038616adec924b4d83fa1f9ec116c582', 'request_id': 'req-3b99c08f-af04-4e84-a8fb-5263d530e0af'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:37.923070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170720-15d5-4b82-8591-8ea97c95364f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:37.999688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:38.000384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.001270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.001667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] PATH_INFO: `/v3/projects/ef18155e2ddb4f33a5e4affb449ca8e1/users/40ac517b6b5842e0a5ac856b2ef4dfb6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.003835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef18155e2ddb4f33a5e4affb449ca8e1, user_id=40ac517b6b5842e0a5ac856b2ef4dfb6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:38.006749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:38.008692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038616adec924b4d83fa1f9ec116c582', 'request_id': 'req-3b99c08f-af04-4e84-a8fb-5263d530e0af'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.017149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038616adec924b4d83fa1f9ec116c582', 'request_id': 'req-3b99c08f-af04-4e84-a8fb-5263d530e0af'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.021748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 978/1931] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:37 2022] PUT /identity/v3/projects/ef18155e2ddb4f33a5e4affb449ca8e1/users/40ac517b6b5842e0a5ac856b2ef4dfb6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:38.027987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:38.039374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] The token cache is being invalidate because project 038616adec924b4d83fa1f9ec116c582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:38.039783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.040722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3b99c08f-af04-4e84-a8fb-5263d530e0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.043123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 954/1932] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:37 2022] DELETE /identity/v3/projects/038616adec924b4d83fa1f9ec116c582 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:38.045277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.045733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.046297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.099990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] MFA Rules not processed for user `40ac517b6b5842e0a5ac856b2ef4dfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:38.101938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:38.144508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e523f-cc81-4d5f-ae47-38dcb260e466 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:38.153587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:38.154924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.155589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.156152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.158934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:38.162623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:38.184291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 979/1933] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:38.185728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:38.191825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 955/1934] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:38.192580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:38.192863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:38.195289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:38.215001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c59c36-a55e-45e3-95ff-2da588b46b4d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:38.217668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2127e-2334-42b2-a824-0c18f7495fd1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:38.222869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:38.224158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.224483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:38.224944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.225297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] PATH_INFO: `/v3/users/619b13e07be0450cba4835da72d39e92` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.225465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.225942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.226332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.226965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619b13e07be0450cba4835da72d39e92)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:38.227138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:38.228766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:38.229384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:38.244910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 956/1935] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:38.244910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:38.248303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:38.332088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5e5e7-0c7f-4232-bdc2-fd4f66e1cbb8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:38.336357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:38.337080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.337386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.337676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.339814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:38.415794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:38.417206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:38.427315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 957/1936] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:38.428190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:38.447751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b6de0-160b-4695-8198-aae269fd6bd8 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:38.453441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80573cd-b52f-4bf1-b870-305888c8d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:38.454940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80573cd-b52f-4bf1-b870-305888c8d660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.455241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80573cd-b52f-4bf1-b870-305888c8d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.455639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80573cd-b52f-4bf1-b870-305888c8d660 admin admin] PATH_INFO: `/v3/projects/6a19a33803ea4f14be1ccf1049914a59/users/d7cc696986324f3195d74c842bebb67f/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.473225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80573cd-b52f-4bf1-b870-305888c8d660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a19a33803ea4f14be1ccf1049914a59, user_id=d7cc696986324f3195d74c842bebb67f, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:38.476386 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80573cd-b52f-4bf1-b870-305888c8d660 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:38.513016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619b13e07be0450cba4835da72d39e92'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.513705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619b13e07be0450cba4835da72d39e92'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.524541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619b13e07be0450cba4835da72d39e92'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.538641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619b13e07be0450cba4835da72d39e92'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.582814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 958/1937] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:38 2022] PUT /identity/v3/projects/6a19a33803ea4f14be1ccf1049914a59/users/d7cc696986324f3195d74c842bebb67f/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:38.593845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.594520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.594520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.628114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] MFA Rules not processed for user `d7cc696986324f3195d74c842bebb67f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:38.629393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:38.666312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619b13e07be0450cba4835da72d39e92'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:38.678094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 980/1938] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:38 2022] DELETE /identity/v3/users/619b13e07be0450cba4835da72d39e92 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:38.717722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 959/1939] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:38.723880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:38.726067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:38.806096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c073c-98a9-47cc-a397-ef035e6bf542 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:38.812235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:38.813873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:38.814159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:38.814444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:38.815494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:38.817520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:39.012746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:39.019711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:39.077761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 981/1940] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:38 2022] POST /identity/v3/projects => generated 369 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:39.085949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:39.113291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b2417-3c91-4cc6-9000-0979d39c6fb8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:39.194303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a2160-2d12-403f-8565-7f1cce2ce6cf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:39.201840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:39.202882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:39.203630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:39.204624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:39.205802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:39.209624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:39.211880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:39.212991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:39.213435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:39.213958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] PATH_INFO: `/v3/users/14056c32c4c8455f8037641e08288941` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:39.215460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14056c32c4c8455f8037641e08288941)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:39.219519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:39.388813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 982/1941] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:39 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:39.393860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:39.404117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42f8a8-0f3d-40d6-9fbf-5c64d78f9da1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:39.409243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:39.409845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:39.410124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:39.410399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:39.411045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:39.412774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:39.424676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 983/1942] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:39.428697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:39.440073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20e56-10b9-4f53-914e-1831ff644aaf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:39.449589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:39.450256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:39.450535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:39.450807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] PATH_INFO: `/v3/projects/58c3d1b3d03d4cbd9a8c5bed5d60dd6c/users/d4070792482d49648968f59bcd58833a/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:39.466219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c3d1b3d03d4cbd9a8c5bed5d60dd6c, user_id=d4070792482d49648968f59bcd58833a, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:39.468908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:39.590496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 984/1943] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:39 2022] PUT /identity/v3/projects/58c3d1b3d03d4cbd9a8c5bed5d60dd6c/users/d4070792482d49648968f59bcd58833a/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:39.591620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:39.593457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:39.602961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14056c32c4c8455f8037641e08288941'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.669858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950d0e7-e642-4918-9b3f-806482f90995 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:39.675523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:39.676162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:39.676440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:39.676717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] PATH_INFO: `/v3/projects/377479e0b43943a6b0314238ba3fcbe1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:39.677856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=377479e0b43943a6b0314238ba3fcbe1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:39.679882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:39.740230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14056c32c4c8455f8037641e08288941'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.762483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14056c32c4c8455f8037641e08288941'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.763536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14056c32c4c8455f8037641e08288941'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.772499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14056c32c4c8455f8037641e08288941'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.779326 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 960/1944] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:39 2022] DELETE /identity/v3/users/14056c32c4c8455f8037641e08288941 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:39.780274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:39.782217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:39.807259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '377479e0b43943a6b0314238ba3fcbe1', 'request_id': 'req-04343e48-8fec-45d2-86f8-f545e10eb679'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.854175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2458b-daf5-4f38-aeef-6a9733332a13 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:39.913786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f82db-752e-40be-a0fd-04354fe9e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:39.914391 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f82db-752e-40be-a0fd-04354fe9e344 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:39.914666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f82db-752e-40be-a0fd-04354fe9e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:39.914933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f82db-752e-40be-a0fd-04354fe9e344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:39.915611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f82db-752e-40be-a0fd-04354fe9e344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:39.917208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f82db-752e-40be-a0fd-04354fe9e344 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:39.928191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 961/1945] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:39.931221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f5fd-b36a-4e8e-a6a5-5a5fdc2eabf8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:39.931588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f5fd-b36a-4e8e-a6a5-5a5fdc2eabf8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:39.931947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5f5fd-b36a-4e8e-a6a5-5a5fdc2eabf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:39.954256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6dc5f5fd-b36a-4e8e-a6a5-5a5fdc2eabf8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:39.955530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6dc5f5fd-b36a-4e8e-a6a5-5a5fdc2eabf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:39.964611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 962/1946] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:39.971524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '377479e0b43943a6b0314238ba3fcbe1', 'request_id': 'req-04343e48-8fec-45d2-86f8-f545e10eb679'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.974149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f5fd-b36a-4e8e-a6a5-5a5fdc2eabf8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:39.980069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '377479e0b43943a6b0314238ba3fcbe1', 'request_id': 'req-04343e48-8fec-45d2-86f8-f545e10eb679'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.992683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5f5fd-b36a-4e8e-a6a5-5a5fdc2eabf8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:39.997823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] The token cache is being invalidate because project 377479e0b43943a6b0314238ba3fcbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:39.998375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:39.999310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:40.001316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:40.001508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 985/1947] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:39 2022] DELETE /identity/v3/projects/377479e0b43943a6b0314238ba3fcbe1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:40.002730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:40.004453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.006434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:40.006893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:40.007406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] PATH_INFO: `/v3/projects/58c3d1b3d03d4cbd9a8c5bed5d60dd6c/users/d4070792482d49648968f59bcd58833a/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:40.011103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c3d1b3d03d4cbd9a8c5bed5d60dd6c, user_id=d4070792482d49648968f59bcd58833a, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:40.014923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:40.032380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 963/1948] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:39 2022] PUT /identity/v3/projects/58c3d1b3d03d4cbd9a8c5bed5d60dd6c/users/d4070792482d49648968f59bcd58833a/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:40.040954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:40.049701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.111683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343e48-8fec-45d2-86f8-f545e10eb679 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:40.161322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc5a82-e66c-434f-b765-868d612685b7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:40.167363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:40.168049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:40.168330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:40.168632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] PATH_INFO: `/v3/users/f080f999ab6e430fa068057469346626` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:40.169971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f080f999ab6e430fa068057469346626)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:40.171993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:40.212603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b188989-6956-480a-bb9b-02d5a825419d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:40.213097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b188989-6956-480a-bb9b-02d5a825419d service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:40.213390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b188989-6956-480a-bb9b-02d5a825419d service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:40.213651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b188989-6956-480a-bb9b-02d5a825419d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:40.216621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5b188989-6956-480a-bb9b-02d5a825419d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.232598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b188989-6956-480a-bb9b-02d5a825419d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:40.234357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b188989-6956-480a-bb9b-02d5a825419d service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:40.246231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 986/1949] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:40.247704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:40.248034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:40.248385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:40.298669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] MFA Rules not processed for user `d4070792482d49648968f59bcd58833a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:40.300937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.439205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:40.447079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 987/1950] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:40.465380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:40.466897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.513970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f080f999ab6e430fa068057469346626'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:40.540737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36402b-0af4-419c-98b2-02713802cba6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:40.546304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:40.546704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:40.547405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:40.547747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:40.562523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:40.564945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:40.591673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 988/1951] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:40.613384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f080f999ab6e430fa068057469346626'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:40.628115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f080f999ab6e430fa068057469346626'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:40.628985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f080f999ab6e430fa068057469346626'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:40.637423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f080f999ab6e430fa068057469346626'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:40.644617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 964/1952] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:40 2022] DELETE /identity/v3/users/f080f999ab6e430fa068057469346626 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:40.648133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:40.757951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:40.759498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.772499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769840a-ace5-44c0-b4cf-dcd50aa75c76 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:40.837598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:40.838279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:40.838624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:40.839023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:40.841434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.859743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:40.863022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:40.945476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:40.947329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:40.958964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 989/1953] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:40.966066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078511f-7125-4318-b3a4-497fa43d2872 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:40.971458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:40.972120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:40.972403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:40.972675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] PATH_INFO: `/v3/projects/738cb43fcdcc43afa627bcd9213a8e41` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:40.976552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738cb43fcdcc43afa627bcd9213a8e41)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:40.979317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:41.183312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738cb43fcdcc43afa627bcd9213a8e41', 'request_id': 'req-9e84e0d8-dbd2-4d85-9d69-babef86ab846'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.293817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738cb43fcdcc43afa627bcd9213a8e41', 'request_id': 'req-9e84e0d8-dbd2-4d85-9d69-babef86ab846'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.306250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738cb43fcdcc43afa627bcd9213a8e41', 'request_id': 'req-9e84e0d8-dbd2-4d85-9d69-babef86ab846'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.320598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] The token cache is being invalidate because project 738cb43fcdcc43afa627bcd9213a8e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:41.321134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.321570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.323151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 965/1954] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:40 2022] DELETE /identity/v3/projects/738cb43fcdcc43afa627bcd9213a8e41 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:41.327680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:41.342627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91253a1-501c-4d8d-9f44-a5d56b188141 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:41.451625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:41.453382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:41.454853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:41.455882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] PATH_INFO: `/v3/users/2f199d80fca5459db847db122714ec3e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:41.459707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f199d80fca5459db847db122714ec3e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:41.465693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:41.728557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f199d80fca5459db847db122714ec3e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.729266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f199d80fca5459db847db122714ec3e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.754934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f199d80fca5459db847db122714ec3e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.780792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f199d80fca5459db847db122714ec3e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:41.892463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:41.894486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:41.998561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84e0d8-dbd2-4d85-9d69-babef86ab846 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:41.998561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:41.998561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:41.998561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:41.999972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] PATH_INFO: `/v3/projects/3d7ed9aad7e74db495c6f9d939368d9a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:41.999972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7ed9aad7e74db495c6f9d939368d9a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:41.999972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:42.145333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d5049351-a677-4e0c-b35c-4f2b0240472a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f199d80fca5459db847db122714ec3e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:42.153637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 990/1955] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:41 2022] DELETE /identity/v3/users/2f199d80fca5459db847db122714ec3e => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:42.236745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7ed9aad7e74db495c6f9d939368d9a', 'request_id': 'req-c1b823f9-2310-48b1-ac7d-d56ffb205438'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:42.413601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7ed9aad7e74db495c6f9d939368d9a', 'request_id': 'req-c1b823f9-2310-48b1-ac7d-d56ffb205438'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:42.425374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7ed9aad7e74db495c6f9d939368d9a', 'request_id': 'req-c1b823f9-2310-48b1-ac7d-d56ffb205438'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:42.448595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] The token cache is being invalidate because project 3d7ed9aad7e74db495c6f9d939368d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:42.449076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:42.450399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c1b823f9-2310-48b1-ac7d-d56ffb205438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:42.460973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 966/1956] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:41 2022] DELETE /identity/v3/projects/3d7ed9aad7e74db495c6f9d939368d9a => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:42.464186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d08da-46e7-4603-ab29-e64fa18824dd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:42.470411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d08da-46e7-4603-ab29-e64fa18824dd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:42.470411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d08da-46e7-4603-ab29-e64fa18824dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:42.506900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a36d08da-46e7-4603-ab29-e64fa18824dd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:42.508799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a36d08da-46e7-4603-ab29-e64fa18824dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:42.674341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 991/1957] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:42.684410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac6cef-51e9-488b-aad7-d536028af3f3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:42.697458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac6cef-51e9-488b-aad7-d536028af3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:42.697458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac6cef-51e9-488b-aad7-d536028af3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:42.727467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bdac6cef-51e9-488b-aad7-d536028af3f3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:42.728826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bdac6cef-51e9-488b-aad7-d536028af3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:42.744236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 967/1958] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:42.745615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d08da-46e7-4603-ab29-e64fa18824dd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:42.761133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d08da-46e7-4603-ab29-e64fa18824dd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:42.763555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:42.764259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:42.764613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:42.765021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:42.765759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:42.767161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:42.769900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:42.790080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 992/1959] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:42.796030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac6cef-51e9-488b-aad7-d536028af3f3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:42.814171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac6cef-51e9-488b-aad7-d536028af3f3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:42.829835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:42.833657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:42.833657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:42.833657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:42.833657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:42.833657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:42.874320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:42.874320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:42.881069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20705c9-ad52-412e-9f84-28f8065f4498 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:42.886568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:42.887222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:42.887543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:42.887825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] PATH_INFO: `/v3/projects/ec9364969c6b4ff9b5afe23ecde12b59` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:42.889211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9364969c6b4ff9b5afe23ecde12b59)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:42.892013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:42.999371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 968/1960] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:42 2022] POST /identity/v3/projects => generated 359 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:43.004296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.118302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65a53c-23db-4bfc-9f81-a123f2aa8d9e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:43.124986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:43.127237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.127415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.127748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.128465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:43.132065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:43.152330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9364969c6b4ff9b5afe23ecde12b59', 'request_id': 'req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:43.249346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9364969c6b4ff9b5afe23ecde12b59', 'request_id': 'req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:43.264697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 969/1961] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:43 2022] POST /identity/v3/users => generated 280 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:43.270803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.283218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51e25d-b4b7-4d4b-b771-5205183b99d8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:43.293736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9364969c6b4ff9b5afe23ecde12b59', 'request_id': 'req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:43.319366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:43.339375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] The token cache is being invalidate because project ec9364969c6b4ff9b5afe23ecde12b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:43.339687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:43.341019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d3ed6f18-b8c2-4895-a30f-851a3d7f7742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:43.346344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 993/1962] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:42 2022] DELETE /identity/v3/projects/ec9364969c6b4ff9b5afe23ecde12b59 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:43.347910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e270b2-c762-4d0f-8af8-675050a715c5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.348195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e270b2-c762-4d0f-8af8-675050a715c5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.348467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e270b2-c762-4d0f-8af8-675050a715c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.371160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c7e270b2-c762-4d0f-8af8-675050a715c5 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:43.372444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c7e270b2-c762-4d0f-8af8-675050a715c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:43.393420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:43.394068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.394353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.395043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.395281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:43.398720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:43.417628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 970/1963] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:43.423178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.428969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:43.442295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b6df-fac3-4f51-b173-419d7e2f5d27 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:43.457757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f96a3-4815-4b97-aa65-4ae6c48f2565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:43.457757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f96a3-4815-4b97-aa65-4ae6c48f2565 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.457757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f96a3-4815-4b97-aa65-4ae6c48f2565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.457757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f96a3-4815-4b97-aa65-4ae6c48f2565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.458117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f96a3-4815-4b97-aa65-4ae6c48f2565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:43.458678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f96a3-4815-4b97-aa65-4ae6c48f2565 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:43.474157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 994/1964] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:43.474787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 971/1965] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:43.475622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f111232-8800-4c87-ba5a-59add0583736 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.475747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e270b2-c762-4d0f-8af8-675050a715c5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.475907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f111232-8800-4c87-ba5a-59add0583736 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.476188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f111232-8800-4c87-ba5a-59add0583736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.488242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e270b2-c762-4d0f-8af8-675050a715c5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:43.494253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ecb6-ed55-4e81-9fbe-bdb09365af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:43.494989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ecb6-ed55-4e81-9fbe-bdb09365af7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.495298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ecb6-ed55-4e81-9fbe-bdb09365af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.495741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ecb6-ed55-4e81-9fbe-bdb09365af7c admin admin] PATH_INFO: `/v3/projects/c087833a133d47c980ff66ed544fbc52/users/61c842c49e32494ba480405e4d0c5357/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.500030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6f111232-8800-4c87-ba5a-59add0583736 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:43.503542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6f111232-8800-4c87-ba5a-59add0583736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:43.514388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 972/1966] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:43.516011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f111232-8800-4c87-ba5a-59add0583736 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.520143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ecb6-ed55-4e81-9fbe-bdb09365af7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c087833a133d47c980ff66ed544fbc52, user_id=61c842c49e32494ba480405e4d0c5357, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:43.529143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ecb6-ed55-4e81-9fbe-bdb09365af7c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:43.531002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f111232-8800-4c87-ba5a-59add0583736 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:43.537255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:43.537882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.538865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.538865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.539230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:43.539585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:43.541267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:43.560009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 973/1967] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:43.565161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.579197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52d22d-645d-4e95-a4e2-6242f6b24105 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:43.588174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:43.588802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.589081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.589403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.590073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:43.592264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:43.644676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 995/1968] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:43 2022] PUT /identity/v3/projects/c087833a133d47c980ff66ed544fbc52/users/61c842c49e32494ba480405e4d0c5357/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:43.656133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.656556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.657064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.688841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] MFA Rules not processed for user `61c842c49e32494ba480405e4d0c5357`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:43.690465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:43.748954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 974/1969] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:43 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:43.753439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.764668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 996/1970] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:43.812369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:43.819538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:43.864139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c894-466d-468e-b7f5-3c14644da177 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:43.874294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:43.876103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:43.876569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:43.877052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:43.877843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:43.880148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:43.942166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf540f-4703-4c2a-b5d4-e1fdeeaf49c9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:44.030783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 975/1971] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:43 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:44.037449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:44.054450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab491-bece-4619-8d64-c06f41f9788a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:44.072284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:44.072985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:44.079130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.080506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.081130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.081667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.082222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.082844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.084843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:44.089410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:44.123502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 976/1972] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:44.130365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:44.152626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72491725-6eee-47a5-a9e4-d067a9924986 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:44.166161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:44.168738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.172838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.172838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.172838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:44.194567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:44.245537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 977/1973] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:44.246793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:44.264058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e1e66-a715-4564-850c-5fe072525e50 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:44.273039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384471f1-6631-4c0e-9468-7cbb2b6a36fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:44.273039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384471f1-6631-4c0e-9468-7cbb2b6a36fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.273039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384471f1-6631-4c0e-9468-7cbb2b6a36fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.273039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384471f1-6631-4c0e-9468-7cbb2b6a36fa admin admin] PATH_INFO: `/v3/projects/9ada444812e84d068b6efc4ec8108bfa/users/e5d500eb8f884ffc96d02b1fd2de5767/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.277294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:44.280378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:44.294809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 997/1974] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:44.296211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384471f1-6631-4c0e-9468-7cbb2b6a36fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ada444812e84d068b6efc4ec8108bfa, user_id=e5d500eb8f884ffc96d02b1fd2de5767, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:44.303301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384471f1-6631-4c0e-9468-7cbb2b6a36fa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:44.315810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:44.329844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fab2f-7939-4f09-8f2e-bb213927e341 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:44.348869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:44.353222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.353222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.353222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] PATH_INFO: `/v3/users/61c842c49e32494ba480405e4d0c5357` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.353222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c842c49e32494ba480405e4d0c5357)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:44.353958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:44.495404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 978/1975] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:44 2022] PUT /identity/v3/projects/9ada444812e84d068b6efc4ec8108bfa/users/e5d500eb8f884ffc96d02b1fd2de5767/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:44.500433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed844-bff1-465b-8feb-e6dba4cefdde None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.501123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed844-bff1-465b-8feb-e6dba4cefdde None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.501702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed844-bff1-465b-8feb-e6dba4cefdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.548420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e81ed844-bff1-465b-8feb-e6dba4cefdde None None] MFA Rules not processed for user `e5d500eb8f884ffc96d02b1fd2de5767`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:44.550046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e81ed844-bff1-465b-8feb-e6dba4cefdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:44.605104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=6,keystone:DELETE=3,keystone:SELECT=91 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:44.679500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 979/1976] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:44.680545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c842c49e32494ba480405e4d0c5357'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:44.681546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c842c49e32494ba480405e4d0c5357'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:44.682225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed844-bff1-465b-8feb-e6dba4cefdde None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:44.690589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c842c49e32494ba480405e4d0c5357'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:44.706417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c842c49e32494ba480405e4d0c5357'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:44.762238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed844-bff1-465b-8feb-e6dba4cefdde None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:44.768274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:44.768991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.769336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.769675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.770805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:44.773711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:44.837369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-100fdea1-3a5c-44c0-8bf2-ff33a41e677d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c842c49e32494ba480405e4d0c5357'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:44.846224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 998/1977] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:44 2022] DELETE /identity/v3/users/61c842c49e32494ba480405e4d0c5357 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:44.852084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.852510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.852988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.873205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:44.874672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:44.885101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 980/1978] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:44 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:44.895438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:44.897721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:44.942671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 999/1979] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:44.953931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:44.955917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:44.976198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf045c-31e6-49ef-b020-ec35f07ef9b3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:44.982427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:44.983110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:44.983424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:44.983705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:44.984490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:44.987468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:45.021376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef07c7b-0e66-426f-9aeb-a5a06d2a27d1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:45.076962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:45.079624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:45.079624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:45.079624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:45.088571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:45.090196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:45.100977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1000/1980] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:45.161585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 981/1981] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:44 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:45.165563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:45.175543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03f87f-92c0-4d0b-a08f-9a5beae26bba service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:45.180666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:45.181288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:45.181598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:45.181876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:45.182681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:45.184520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:45.195652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1001/1982] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:45.199718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:45.211067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0469568-ff88-4ec8-a909-10b8d58670ab admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:45.215718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5351a7b-cc3a-4af4-8301-af17fbfd5101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:45.216336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5351a7b-cc3a-4af4-8301-af17fbfd5101 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:45.216607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5351a7b-cc3a-4af4-8301-af17fbfd5101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:45.216877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5351a7b-cc3a-4af4-8301-af17fbfd5101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:45.217512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5351a7b-cc3a-4af4-8301-af17fbfd5101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:45.219167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5351a7b-cc3a-4af4-8301-af17fbfd5101 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:45.229004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 982/1983] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:45.233286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:45.243592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b5476-616c-4ed4-b75d-fc4b4b32f174 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:45.248259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:45.248912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:45.249196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:45.249471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] PATH_INFO: `/v3/projects/c54a2fa413534457bb07fa802dbd0a12/users/798e285356c64d619ec85c1a25875506/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:45.264843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54a2fa413534457bb07fa802dbd0a12, user_id=798e285356c64d619ec85c1a25875506, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:45.268245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:45.446383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1002/1984] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:45 2022] PUT /identity/v3/projects/c54a2fa413534457bb07fa802dbd0a12/users/798e285356c64d619ec85c1a25875506/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:45.459060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:45.459570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:45.460020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:45.495845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] MFA Rules not processed for user `798e285356c64d619ec85c1a25875506`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:45.503441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:45.623149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 983/1985] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:45.628841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:45.741521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe5223-17fd-4b72-b778-912abd41c257 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:45.746724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:45.747132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:45.747477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:45.747779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:45.748401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:45.750913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:45.879677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:45.881712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:45.900099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c70987-7d0a-4b4a-8975-21dd1dd7ca98 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:45.905443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:45.907912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:45.908186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:45.910195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] PATH_INFO: `/v3/projects/c087833a133d47c980ff66ed544fbc52` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:45.916636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1003/1986] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:45 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:45.917017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c087833a133d47c980ff66ed544fbc52)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:45.917017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:45.918676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:45.975606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:45.997259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39d19a-33f9-4eed-af45-9f6f234c350d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.002774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.003725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.004157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.004482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.005404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.007499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.106628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c087833a133d47c980ff66ed544fbc52', 'request_id': 'req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:46.191503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1004/1987] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:45 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:46.195497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.206600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8ffe9-5286-4e10-a0de-d00830015cd4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.213828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c087833a133d47c980ff66ed544fbc52', 'request_id': 'req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:46.222899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c087833a133d47c980ff66ed544fbc52', 'request_id': 'req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:46.237106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] The token cache is being invalidate because project c087833a133d47c980ff66ed544fbc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:46.237513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:46.238055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-64cf47f7-88cd-4d3d-8bf0-621d31fa1814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:46.239706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 984/1988] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:45 2022] DELETE /identity/v3/projects/c087833a133d47c980ff66ed544fbc52 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:46.245393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f01be-bd0d-4269-8f08-c16c8ac35a60 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.245951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f01be-bd0d-4269-8f08-c16c8ac35a60 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.246240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f01be-bd0d-4269-8f08-c16c8ac35a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.269697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e79f01be-bd0d-4269-8f08-c16c8ac35a60 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:46.271138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e79f01be-bd0d-4269-8f08-c16c8ac35a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:46.287130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.287785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.288066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.288340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.288991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.290605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.303418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1005/1989] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:46.310655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.310655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:46.323905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8286-ddd2-4341-88d2-3cc8b9c1d299 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.329922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.330625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.330911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.331406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] PATH_INFO: `/v3/projects/599c742737a84110b008af9fbca83ce8/users/da899b7cc9f34fa6a3e8bf9cf5ce1cfc/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.337060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 985/1990] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:46.349813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599c742737a84110b008af9fbca83ce8, user_id=da899b7cc9f34fa6a3e8bf9cf5ce1cfc, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.350840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb094-297b-438a-a00d-d89497439430 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.351132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb094-297b-438a-a00d-d89497439430 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.351430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb094-297b-438a-a00d-d89497439430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.352946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.374819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9b0bb094-297b-438a-a00d-d89497439430 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:46.376503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9b0bb094-297b-438a-a00d-d89497439430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:46.389318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 986/1991] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:46.392258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bb094-297b-438a-a00d-d89497439430 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.402489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bb094-297b-438a-a00d-d89497439430 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.408285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.408912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.409266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.410505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.410663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:46.411117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.412758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.428614 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 987/1992] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:35:46.433224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.448516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b437364-b8c3-4602-9718-ecd3f0e4e79c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.455330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.455975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.456266 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.456676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.457252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.459238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.493612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1006/1993] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:46 2022] PUT /identity/v3/projects/599c742737a84110b008af9fbca83ce8/users/da899b7cc9f34fa6a3e8bf9cf5ce1cfc/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:46.495623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.561156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 988/1994] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:46 2022] POST /identity/v3/projects => generated 397 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:46.569224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.585587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759e15-119f-4bd1-b4e6-fe7249c0d8d0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.676599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80000ecc-3e92-4944-983f-8dd537c57a58 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.681167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.682008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.682431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.683050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.683223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.683541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.684111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.684111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.684366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.684820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.686403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.687185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.702336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1007/1995] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:46.708162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.724263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f0e16-18e9-4213-b7aa-de5785f50e81 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.729354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f3773-ae90-4cd7-b7ef-bb8c1cafaf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.730038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f3773-ae90-4cd7-b7ef-bb8c1cafaf40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.730322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f3773-ae90-4cd7-b7ef-bb8c1cafaf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.730606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f3773-ae90-4cd7-b7ef-bb8c1cafaf40 admin admin] PATH_INFO: `/v3/projects/599c742737a84110b008af9fbca83ce8/users/da899b7cc9f34fa6a3e8bf9cf5ce1cfc/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.733435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f3773-ae90-4cd7-b7ef-bb8c1cafaf40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599c742737a84110b008af9fbca83ce8, user_id=da899b7cc9f34fa6a3e8bf9cf5ce1cfc, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.736669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f3773-ae90-4cd7-b7ef-bb8c1cafaf40 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.749438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1008/1996] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:46 2022] PUT /identity/v3/projects/599c742737a84110b008af9fbca83ce8/users/da899b7cc9f34fa6a3e8bf9cf5ce1cfc/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:46.761058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.761372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.761678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.799073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] MFA Rules not processed for user `da899b7cc9f34fa6a3e8bf9cf5ce1cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:46.800436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:46.857394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 989/1997] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:46 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:46.861808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.877325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bf208-366e-4487-ba92-0e2a133f14aa admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:46.923555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1009/1998] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:46.948511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:46.952657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:46.960056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:46.960835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:46.961185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:46.961569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:46.962334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:46.964281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:46.975934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 990/1999] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:46.984047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:47.005071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51c247-8800-4967-9db5-cd173049796d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:47.021160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:47.022515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:47.022515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:47.022515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:47.023936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:47.026269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:47.038994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 991/2000] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:47.045251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:47.050024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c3f40-bebd-44db-912b-dee7c235bbc5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:47.059070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcd577-e05e-4b50-9a4d-e185c583cd38 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:47.070125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15b794-ffbb-4c22-a03f-af669ba8245d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:47.070942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15b794-ffbb-4c22-a03f-af669ba8245d service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:47.071221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15b794-ffbb-4c22-a03f-af669ba8245d service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:47.071527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15b794-ffbb-4c22-a03f-af669ba8245d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:47.075740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:47.079549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:47.079549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:47.079549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] PATH_INFO: `/v3/projects/2cfcc8f7fc704021b49546f06178df56/users/6ab2004827d74bee839bbf54f0726f3e/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:47.083472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15b794-ffbb-4c22-a03f-af669ba8245d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:47.085085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15b794-ffbb-4c22-a03f-af669ba8245d service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:47.102715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1010/2001] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:47.104322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cfcc8f7fc704021b49546f06178df56, user_id=6ab2004827d74bee839bbf54f0726f3e, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:47.107208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:47.221966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 992/2002] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:47 2022] PUT /identity/v3/projects/2cfcc8f7fc704021b49546f06178df56/users/6ab2004827d74bee839bbf54f0726f3e/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:47.241440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:47.241636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:47.241952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:47.275655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] MFA Rules not processed for user `6ab2004827d74bee839bbf54f0726f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:47.279840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:47.365460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1011/2003] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:47.382211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:47.384508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:47.448758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:47.450528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:47.490501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aac0eb-5983-4bbc-8619-bce1117e3b98 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:47.494669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:47.495289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:47.496015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:47.496015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:47.506732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:47.508670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:47.522876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 993/2004] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:47.538135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef12231-3d59-47da-955b-fd6cec16ee2b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:47.545189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:47.546361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:47.546898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:47.547955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] PATH_INFO: `/v3/users/d7cc696986324f3195d74c842bebb67f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:47.550253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cc696986324f3195d74c842bebb67f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:47.553352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:47.734655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:47.745387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f66e5-942b-4f9c-8590-bc5c01c4c1d4 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:47.748701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43852782-1fd9-4fd2-aa24-ecab0d6eac95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:47.749485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852782-1fd9-4fd2-aa24-ecab0d6eac95 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:47.749773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852782-1fd9-4fd2-aa24-ecab0d6eac95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:47.750101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852782-1fd9-4fd2-aa24-ecab0d6eac95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:47.752067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-43852782-1fd9-4fd2-aa24-ecab0d6eac95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:47.832888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43852782-1fd9-4fd2-aa24-ecab0d6eac95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:47.834409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43852782-1fd9-4fd2-aa24-ecab0d6eac95 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:47.845669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 994/2005] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:47.903305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cc696986324f3195d74c842bebb67f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:47.906145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cc696986324f3195d74c842bebb67f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:47.917009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cc696986324f3195d74c842bebb67f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:47.930698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cc696986324f3195d74c842bebb67f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:48.025911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cc696986324f3195d74c842bebb67f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:48.034597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1012/2006] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:47 2022] DELETE /identity/v3/users/d7cc696986324f3195d74c842bebb67f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:48.039137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:48.039603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:48.039889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:48.062147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:48.063914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:48.153935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 995/2007] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:48.184165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:48.186207 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:48.263112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dffb4-9545-4bd1-8ed5-ecf8b0205b15 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:48.268476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:48.269190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:48.269540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:48.269880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:48.282353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:48.283220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:48.295122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1013/2008] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:48.312000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:48.581167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:48.825820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:48.827275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:48.894872 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65a885-7769-4bf7-bb61-3738622bd26b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:48.899012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:48.899582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:48.899907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:48.900175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:48.902202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:48.951424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:48.953062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:48.975610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0b88-980c-4917-b683-082ba2e8a961 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:48.982553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:48.983596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:48.984193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:48.985581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] PATH_INFO: `/v3/projects/6a19a33803ea4f14be1ccf1049914a59` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:48.987943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a19a33803ea4f14be1ccf1049914a59)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:48.991076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:49.118527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:49.118527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:49.118527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 996/2009] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:49.248242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a19a33803ea4f14be1ccf1049914a59', 'request_id': 'req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:49.348939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a19a33803ea4f14be1ccf1049914a59', 'request_id': 'req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:49.355498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a19a33803ea4f14be1ccf1049914a59', 'request_id': 'req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:49.367522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] The token cache is being invalidate because project 6a19a33803ea4f14be1ccf1049914a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:49.367722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:49.368634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:49.370133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1014/2010] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:48 2022] DELETE /identity/v3/projects/6a19a33803ea4f14be1ccf1049914a59 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:49.374189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:49.385725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd78678-a5a3-4219-b756-63267bc28385 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:49.445295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:49.445873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:49.446166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:49.446491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] PATH_INFO: `/v3/users/d4070792482d49648968f59bcd58833a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:49.447824 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4070792482d49648968f59bcd58833a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:49.449769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:49.947243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4070792482d49648968f59bcd58833a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:50.031309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4070792482d49648968f59bcd58833a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:50.052370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4070792482d49648968f59bcd58833a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:50.054044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4070792482d49648968f59bcd58833a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:50.069910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9ed683e8-364c-483c-8448-d97796ba94da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4070792482d49648968f59bcd58833a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:50.077854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 997/2011] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:49 2022] DELETE /identity/v3/users/d4070792482d49648968f59bcd58833a => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:50.671284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:50.758948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:50.760703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:50.774898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083b7d7-25b8-48e9-8051-c231fa3e0ca5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:50.904206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:50.905134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:50.905579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:50.906027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] PATH_INFO: `/v3/projects/58c3d1b3d03d4cbd9a8c5bed5d60dd6c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:50.909512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c3d1b3d03d4cbd9a8c5bed5d60dd6c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:50.911608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:50.956553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:51.125867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c3d1b3d03d4cbd9a8c5bed5d60dd6c', 'request_id': 'req-98c115e9-2a9b-4564-9584-1adfdbfbb418'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:51.276224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c3d1b3d03d4cbd9a8c5bed5d60dd6c', 'request_id': 'req-98c115e9-2a9b-4564-9584-1adfdbfbb418'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:51.283369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c3d1b3d03d4cbd9a8c5bed5d60dd6c', 'request_id': 'req-98c115e9-2a9b-4564-9584-1adfdbfbb418'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:51.295732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] The token cache is being invalidate because project 58c3d1b3d03d4cbd9a8c5bed5d60dd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:51.296025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:51.296776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-98c115e9-2a9b-4564-9584-1adfdbfbb418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:51.298430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1015/2012] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:50 2022] DELETE /identity/v3/projects/58c3d1b3d03d4cbd9a8c5bed5d60dd6c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:51.303907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d2a51-26c0-490d-a6ac-3f9b1f552348 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:51.304135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d2a51-26c0-490d-a6ac-3f9b1f552348 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:51.304483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d2a51-26c0-490d-a6ac-3f9b1f552348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:51.345309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-432d2a51-26c0-490d-a6ac-3f9b1f552348 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:51.347405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-432d2a51-26c0-490d-a6ac-3f9b1f552348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:51.441707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 998/2013] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:51.451109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab8555-ba07-4964-b97a-a2e8c0e093f0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:51.451634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab8555-ba07-4964-b97a-a2e8c0e093f0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:51.452052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab8555-ba07-4964-b97a-a2e8c0e093f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:51.493794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f8ab8555-ba07-4964-b97a-a2e8c0e093f0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:51.495776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f8ab8555-ba07-4964-b97a-a2e8c0e093f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:51.507475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1016/2014] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:51.513327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d2a51-26c0-490d-a6ac-3f9b1f552348 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:51.527519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d2a51-26c0-490d-a6ac-3f9b1f552348 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:51.534502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:51.536646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:51.536940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:51.537242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:51.537896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:51.538207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:51.539896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:51.557767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 999/2015] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:51.559735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab8555-ba07-4964-b97a-a2e8c0e093f0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:51.572904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab8555-ba07-4964-b97a-a2e8c0e093f0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:51.596940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:51.597915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:51.598414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:51.599567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:51.614181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:51.614181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:51.646962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:51.713745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1017/2016] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:51 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:51.717820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:51.730384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799786a-447d-4cb8-b80b-35df06da4a4e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:51.801295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:51.802316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:51.802609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:51.802882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:51.803652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:51.806398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:51.929243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1000/2017] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:51 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:51.933347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:51.947738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a474ec-809d-416c-9bc0-63125ff1fa09 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:51.953099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:51.954440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:51.955063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:51.955575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:51.960316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:51.960316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:51.971909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1018/2018] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:51.976798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:51.990401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafba80-9392-4d90-b2e2-4fe6b43faf31 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:52.011118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d44e31-32ff-4ce4-89b1-b1556ac400a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:52.019014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44e31-32ff-4ce4-89b1-b1556ac400a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.019014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44e31-32ff-4ce4-89b1-b1556ac400a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.019014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d44e31-32ff-4ce4-89b1-b1556ac400a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.019014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d44e31-32ff-4ce4-89b1-b1556ac400a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:52.019014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d44e31-32ff-4ce4-89b1-b1556ac400a4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:52.030338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1001/2019] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:52.035300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:52.046347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40915-5791-444a-952c-7fda47d76073 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:52.051621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be26b2-dc9d-4eaf-ae04-5340164d4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:52.052308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be26b2-dc9d-4eaf-ae04-5340164d4042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.052586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be26b2-dc9d-4eaf-ae04-5340164d4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.052982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be26b2-dc9d-4eaf-ae04-5340164d4042 admin admin] PATH_INFO: `/v3/projects/d50419e7964348b9a1fc190cd6de02d2/users/38d670febffb45d8968988ae6e9790cd/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.070911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be26b2-dc9d-4eaf-ae04-5340164d4042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50419e7964348b9a1fc190cd6de02d2, user_id=38d670febffb45d8968988ae6e9790cd, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:52.074036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be26b2-dc9d-4eaf-ae04-5340164d4042 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:52.227042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1019/2020] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:52 2022] PUT /identity/v3/projects/d50419e7964348b9a1fc190cd6de02d2/users/38d670febffb45d8968988ae6e9790cd/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:52.229177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b8a4-1aee-4516-8ef9-1c3e9e626b73 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.235273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b8a4-1aee-4516-8ef9-1c3e9e626b73 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.235273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89b8a4-1aee-4516-8ef9-1c3e9e626b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.239969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb730f2-8fb9-435e-95ba-08532a2fc0c6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.241171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb730f2-8fb9-435e-95ba-08532a2fc0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.241448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb730f2-8fb9-435e-95ba-08532a2fc0c6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.247639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1020/2021] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:35:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:35:52.256942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4581ac-6db1-47da-b753-54b75cad4465 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.257857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4581ac-6db1-47da-b753-54b75cad4465 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.258315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4581ac-6db1-47da-b753-54b75cad4465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.285795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ac89b8a4-1aee-4516-8ef9-1c3e9e626b73 None None] MFA Rules not processed for user `38d670febffb45d8968988ae6e9790cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:52.287512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ac89b8a4-1aee-4516-8ef9-1c3e9e626b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:52.299613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6b4581ac-6db1-47da-b753-54b75cad4465 None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:52.301124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6b4581ac-6db1-47da-b753-54b75cad4465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:52.382629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1021/2022] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:52.395533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28ce6-2eab-44e0-af5a-0134a79444d5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.395533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28ce6-2eab-44e0-af5a-0134a79444d5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.395871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a28ce6-2eab-44e0-af5a-0134a79444d5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.397326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1022/2023] 10.222.0.49 () {54 vars in 961 bytes} [Mon Sep 26 12:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 12:35:52.403813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1002/2024] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:52.404103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.404103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.404103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.405395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89b8a4-1aee-4516-8ef9-1c3e9e626b73 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:52.424639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] MFA Rules not processed for user `ba94572d0db5429ab9275319ef2ee403`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:52.426032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:52.440514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1023/2025] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Sep 26 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:52.446496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:52.448119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:52.494740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89b8a4-1aee-4516-8ef9-1c3e9e626b73 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:52.499754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:52.501111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.501399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.501676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.502343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:52.504358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:52.528444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189660ec-a7fb-41ea-bd47-687b14f47c8d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:52.533620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:52.534262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.534544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.535447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] PATH_INFO: `/v3/users/d8746f97fe904ea29de76150a817a2b2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.536559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8746f97fe904ea29de76150a817a2b2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:52.538076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:52.646987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1003/2026] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:52 2022] POST /identity/v3/projects => generated 393 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:52.648277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:52.741868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:52.746588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b8872-a9a5-47a1-a237-3780f5fdadbe admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:52.752117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:52.754213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.754213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.754213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.762878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:52.764540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:52.775057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1004/2027] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:52.777605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:52.864563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8746f97fe904ea29de76150a817a2b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:52.865235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8746f97fe904ea29de76150a817a2b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:52.868106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2471c-2848-4496-be72-6e270d71d51c service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:52.873005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:52.874076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:52.874376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:52.874632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:52.876059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:52.876265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8746f97fe904ea29de76150a817a2b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:52.878164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:52.889120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8746f97fe904ea29de76150a817a2b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:53.002240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8746f97fe904ea29de76150a817a2b2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:53.009056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1005/2029] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:52 2022] POST /identity/v3/users => generated 303 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:53.011863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1024/2029] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:52 2022] DELETE /identity/v3/users/d8746f97fe904ea29de76150a817a2b2 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:53.015003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.016676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.028957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b18310-e7ac-425a-be6b-4cced0b00651 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.093469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.094215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.094706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.095051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.095742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:53.097545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:53.108188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1006/2030] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:53.113314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.124514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366107-7120-4ecc-954e-961dff5bcc92 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.130675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.131548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.132032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.132141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] PATH_INFO: `/v3/projects/698a3c8b406e4875b7fac73a06d3db98/users/bd377dbd8f9b4aa1ad43e17ea2cf6064/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.149261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698a3c8b406e4875b7fac73a06d3db98, user_id=bd377dbd8f9b4aa1ad43e17ea2cf6064, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:53.152021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:53.318169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.320700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.321177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1025/2031] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:53 2022] PUT /identity/v3/projects/698a3c8b406e4875b7fac73a06d3db98/users/bd377dbd8f9b4aa1ad43e17ea2cf6064/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:53.322163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.339146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa484e8-4166-44b5-871d-634f265aba11 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.408821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:53.416871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb510c5-0151-43b8-888c-3c966854af72 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.420695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.421314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.421593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.421935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.423287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:53.424962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:53.433313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.434399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.434894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.435412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] PATH_INFO: `/v3/projects/451c0ff147cb4625811c781546d28862` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.439391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1026/2032] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:53.440745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.441750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=451c0ff147cb4625811c781546d28862)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:53.443934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:53.455135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1865ec-6748-4711-9bed-90295417395e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.463755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f917f2-c936-44ff-9538-aa7f29d21775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.464308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f917f2-c936-44ff-9538-aa7f29d21775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.464798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f917f2-c936-44ff-9538-aa7f29d21775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.465167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f917f2-c936-44ff-9538-aa7f29d21775 admin admin] PATH_INFO: `/v3/projects/698a3c8b406e4875b7fac73a06d3db98/users/bd377dbd8f9b4aa1ad43e17ea2cf6064/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.467315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f917f2-c936-44ff-9538-aa7f29d21775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698a3c8b406e4875b7fac73a06d3db98, user_id=bd377dbd8f9b4aa1ad43e17ea2cf6064, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:53.471243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f917f2-c936-44ff-9538-aa7f29d21775 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:53.482994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1027/2033] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:53 2022] PUT /identity/v3/projects/698a3c8b406e4875b7fac73a06d3db98/users/bd377dbd8f9b4aa1ad43e17ea2cf6064/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:53.494598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.495154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.495400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.533874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] MFA Rules not processed for user `bd377dbd8f9b4aa1ad43e17ea2cf6064`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:53.535522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.577603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451c0ff147cb4625811c781546d28862', 'request_id': 'req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:53.609151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1028/2034] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:53.620744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.622133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.689503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f263a2d-072a-44a9-9ed9-c9cf54ab32c7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.750653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8999056-34ed-4c3f-bd70-262792899eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.750653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8999056-34ed-4c3f-bd70-262792899eff service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.750653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8999056-34ed-4c3f-bd70-262792899eff service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.750653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8999056-34ed-4c3f-bd70-262792899eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.760297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451c0ff147cb4625811c781546d28862', 'request_id': 'req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:53.769291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451c0ff147cb4625811c781546d28862', 'request_id': 'req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:53.783443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] The token cache is being invalidate because project 451c0ff147cb4625811c781546d28862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:53.783937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:53.784909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7a104e9d-bc5e-4ed2-8252-da7272edc2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:53.788781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1007/2035] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:53 2022] DELETE /identity/v3/projects/451c0ff147cb4625811c781546d28862 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:53.794461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.794836 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.795161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.823131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:53.824505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.837918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8999056-34ed-4c3f-bd70-262792899eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:53.839291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8999056-34ed-4c3f-bd70-262792899eff service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:53.853150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1029/2036] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:53.902643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1008/2037] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:53.912307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b24ac-52ad-4916-8251-e32b94e5020c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.913141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b24ac-52ad-4916-8251-e32b94e5020c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.913141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b24ac-52ad-4916-8251-e32b94e5020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.933188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.933188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.938221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-906b24ac-52ad-4916-8251-e32b94e5020c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:53.939935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3c03a-65f6-4df2-b0d3-98619aa71b12 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.940076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-906b24ac-52ad-4916-8251-e32b94e5020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.944028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.945327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.945613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.945886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.947835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:53.948731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1030/2038] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:53.953643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b24ac-52ad-4916-8251-e32b94e5020c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:53.963729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b24ac-52ad-4916-8251-e32b94e5020c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:53.972607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:53.973375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:53.973657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:53.973984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:53.974730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:53.975040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:53.976802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:53.999331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1031/2039] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:35:54.001703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:54.017446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8eefc-ef94-4f72-86f5-2c95695c077a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:54.021728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:54.027561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:54.027832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:54.027832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:54.027832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:54.027832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:54.028186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:54.028186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:54.035650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1009/2040] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:54.166715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1032/2041] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:54 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:54.170890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:54.182079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402f76a-853a-45f1-a695-d8a38ff86acb service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:54.256480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:54.257267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:54.258164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:54.258164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:54.258702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:54.261455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:54.430263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1010/2042] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:54 2022] POST /identity/v3/users => generated 286 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:54.434681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:54.446845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac687183-4029-4132-b802-7ab3b41bad3d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:54.454372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:54.456654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:54.457875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:54.458440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:54.460023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:54.464115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:54.492473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1033/2043] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:54.494184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:54.509580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faaf00-5dc6-4e09-b1e4-c74f65dc0f1c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:54.514367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee98ad1-15e1-4eb7-ab0f-5e5057a525e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:54.514904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98ad1-15e1-4eb7-ab0f-5e5057a525e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:54.515249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98ad1-15e1-4eb7-ab0f-5e5057a525e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:54.515644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee98ad1-15e1-4eb7-ab0f-5e5057a525e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:54.516724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee98ad1-15e1-4eb7-ab0f-5e5057a525e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:54.518493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee98ad1-15e1-4eb7-ab0f-5e5057a525e8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:54.532380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1011/2044] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:54.534798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:54.564675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8efedf-00dd-474e-b3cb-21d178124647 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:54.571249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:54.571976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:54.572942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:54.572942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] PATH_INFO: `/v3/projects/b0ce487ae4214d61bdc5848b7a2b125b/users/c75c664b96c44ec982ae98a50c6c3732/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:54.591588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ce487ae4214d61bdc5848b7a2b125b, user_id=c75c664b96c44ec982ae98a50c6c3732, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:54.597385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:54.763929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:54.769404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1034/2045] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:54 2022] PUT /identity/v3/projects/b0ce487ae4214d61bdc5848b7a2b125b/users/c75c664b96c44ec982ae98a50c6c3732/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:54.780951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f00b0-3ddd-45a3-ba45-c40365791505 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:54.781903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f00b0-3ddd-45a3-ba45-c40365791505 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:54.782264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f00b0-3ddd-45a3-ba45-c40365791505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:54.852808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c91f00b0-3ddd-45a3-ba45-c40365791505 None None] MFA Rules not processed for user `c75c664b96c44ec982ae98a50c6c3732`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:54.854055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c91f00b0-3ddd-45a3-ba45-c40365791505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:54.933430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1012/2046] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:54.947973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:54.949897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:55.051039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cd23a-ca15-42d7-bc13-a4613c0f4de4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:55.061133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1182b25-4e53-4330-aca7-3e050af54a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:55.061133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182b25-4e53-4330-aca7-3e050af54a2f service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:55.061133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182b25-4e53-4330-aca7-3e050af54a2f service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:55.061133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182b25-4e53-4330-aca7-3e050af54a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:55.076276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1182b25-4e53-4330-aca7-3e050af54a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:55.078613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1182b25-4e53-4330-aca7-3e050af54a2f service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:55.096150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1035/2047] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:55.347151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f00b0-3ddd-45a3-ba45-c40365791505 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:55.426210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f00b0-3ddd-45a3-ba45-c40365791505 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:55.431762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:55.438578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:55.438578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:55.438578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] PATH_INFO: `/v3/users/c75c664b96c44ec982ae98a50c6c3732` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:55.438578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75c664b96c44ec982ae98a50c6c3732)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:55.438578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:55.682468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75c664b96c44ec982ae98a50c6c3732'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:55.801905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75c664b96c44ec982ae98a50c6c3732'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:55.816104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75c664b96c44ec982ae98a50c6c3732'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:55.816950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75c664b96c44ec982ae98a50c6c3732'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:55.824934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75c664b96c44ec982ae98a50c6c3732'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:55.833444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1013/2048] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:55 2022] DELETE /identity/v3/users/c75c664b96c44ec982ae98a50c6c3732 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:55.838412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:55.838704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:55.840152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:55.862793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:55.864048 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:55.934215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1036/2049] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:55.944816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:55.946424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:56.006771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af149f9-d314-41d7-a797-ec4ac1eb9762 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:56.010751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8afcc4-d3f1-49b3-a5f7-36cc20fe58d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:56.011404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8afcc4-d3f1-49b3-a5f7-36cc20fe58d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:56.011697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8afcc4-d3f1-49b3-a5f7-36cc20fe58d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:56.011967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8afcc4-d3f1-49b3-a5f7-36cc20fe58d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:56.022096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8afcc4-d3f1-49b3-a5f7-36cc20fe58d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:56.023629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8afcc4-d3f1-49b3-a5f7-36cc20fe58d1 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:56.033937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1014/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:56.040493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:56.292500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:56.522996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:56.524566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:56.537135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0838e08-349e-4d28-a315-5d9975fdc015 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:56.542969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:56.543643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:56.543921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:56.544190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] PATH_INFO: `/v3/projects/b0ce487ae4214d61bdc5848b7a2b125b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:56.545333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ce487ae4214d61bdc5848b7a2b125b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:56.547299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:56.698054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ce487ae4214d61bdc5848b7a2b125b', 'request_id': 'req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:56.816198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ce487ae4214d61bdc5848b7a2b125b', 'request_id': 'req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:56.822816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ce487ae4214d61bdc5848b7a2b125b', 'request_id': 'req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:56.837110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] The token cache is being invalidate because project b0ce487ae4214d61bdc5848b7a2b125b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:56.837442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:56.838120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf7c1f31-f00d-4e18-825d-ba3d120fa6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:56.839691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1037/2051] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:56 2022] DELETE /identity/v3/projects/b0ce487ae4214d61bdc5848b7a2b125b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:56.845506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:56.846001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:56.846093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:56.866496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:56.867826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:56.936793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1015/2052] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:56.946642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519c8c-18c6-46f5-ba42-7b2405b3f3b8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:56.946932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519c8c-18c6-46f5-ba42-7b2405b3f3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:56.947213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f519c8c-18c6-46f5-ba42-7b2405b3f3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:56.970880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8f519c8c-18c6-46f5-ba42-7b2405b3f3b8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:56.972212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8f519c8c-18c6-46f5-ba42-7b2405b3f3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:56.986176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1038/2053] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:35:56.987211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:56.989532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519c8c-18c6-46f5-ba42-7b2405b3f3b8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:56.989677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:57.000067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f519c8c-18c6-46f5-ba42-7b2405b3f3b8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.003091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e7215-abee-49be-bcae-bd382fc334d8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.005530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.010812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.010812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.010812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.010812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:35:57.010812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.011227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.011227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.011227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.011227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] PATH_INFO: `/v3/users/46e8b0f3037748c4bc964162f7ec8577` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.011572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.012680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e8b0f3037748c4bc964162f7ec8577)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.015292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.030094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1039/2054] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:35:57.030094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:57.032227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:57.107994 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46afa0-affb-4093-9f45-095ba9d6d72b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.108549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.108738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.109012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.109301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.111094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:57.175957 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.177402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.186771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1040/2055] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:57.188432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:57.199367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bd7f7-5a3d-47ec-b503-94d7c8805292 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.204917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.205612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.205883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.206178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.206814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.208902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.220349 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:57.233164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e8b0f3037748c4bc964162f7ec8577'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:57.315930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e8b0f3037748c4bc964162f7ec8577'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:57.331963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1041/2056] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:57 2022] POST /identity/v3/projects => generated 355 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:57.333709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e8b0f3037748c4bc964162f7ec8577'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:57.333890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:57.334806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e8b0f3037748c4bc964162f7ec8577'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:57.336396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:57.346706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c2909bde-910c-49a6-98a2-e9d399f9efc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e8b0f3037748c4bc964162f7ec8577'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:57.356379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1016/2057] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:56 2022] DELETE /identity/v3/users/46e8b0f3037748c4bc964162f7ec8577 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:57.362994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.364421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.364880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.392423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:57.393648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:57.418367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29288d4-dc96-4e94-93ca-1cd9f8bd49ec admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.469078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1017/2058] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:57.483047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:57.485218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:57.503983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.504670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.504992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.505282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.505946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.508516 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.551353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf1ad0-321c-471d-ad2a-6f37fe7685bc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.554183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.554817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.555628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.555918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.567482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.569167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.579766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1018/2059] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:57.659992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1042/2060] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:57 2022] POST /identity/v3/users => generated 278 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:57.664396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:57.682973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc24f4-3163-4a60-a7a9-8e43a2194889 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.682973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.682973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.682973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.683333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.683333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.683333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.694172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1019/2061] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:57.699960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:57.723734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37b702-4363-4caa-b8e1-915381cd4767 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.732945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f14e-1621-4a68-a474-c7cae583a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.732945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f14e-1621-4a68-a474-c7cae583a1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.732945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f14e-1621-4a68-a474-c7cae583a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.732945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f14e-1621-4a68-a474-c7cae583a1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.733706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f14e-1621-4a68-a474-c7cae583a1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.736833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f14e-1621-4a68-a474-c7cae583a1e0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.749017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1043/2062] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:35:57.753105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:57.764051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ddac-e649-4e24-bd18-a151f36b7ba9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:57.769576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:57.770247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.770521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.770794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] PATH_INFO: `/v3/projects/d76fdfdff0cf4374b87f2db26c942ac5/users/eef11344533e4e7397e80efa23039797/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.788835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76fdfdff0cf4374b87f2db26c942ac5, user_id=eef11344533e4e7397e80efa23039797, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:57.791835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:57.909327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1020/2063] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:57 2022] PUT /identity/v3/projects/d76fdfdff0cf4374b87f2db26c942ac5/users/eef11344533e4e7397e80efa23039797/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:57.926419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:57.929118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:57.929118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:57.963922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] MFA Rules not processed for user `eef11344533e4e7397e80efa23039797`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:57.963922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:58.069031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1044/2064] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:58.073535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.144466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19626b-efe4-4c19-8cbb-cb1b338ac96b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.150404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.151039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.151327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.151660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.152315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.154550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.179048 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.181015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:58.202980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecce34-ab6e-4811-98cb-2ac3380789e7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.209669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.211550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.211550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.211550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] PATH_INFO: `/v3/projects/0e7da995a6824d13a03f152dc451a0dc` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.212451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7da995a6824d13a03f152dc451a0dc)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.214478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.345803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1021/2065] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:35:58 2022] POST /identity/v3/projects => generated 355 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:35:58.349978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.396627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7da995a6824d13a03f152dc451a0dc', 'request_id': 'req-ab9c512b-485c-48a2-ab63-5ec13651d244'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.423935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465862d4-7473-42e4-8ba0-6cba4f2b7c5f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.484006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7da995a6824d13a03f152dc451a0dc', 'request_id': 'req-ab9c512b-485c-48a2-ab63-5ec13651d244'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.496474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7da995a6824d13a03f152dc451a0dc', 'request_id': 'req-ab9c512b-485c-48a2-ab63-5ec13651d244'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.504636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.505858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.506769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.508011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.508874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.511480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.517980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] The token cache is being invalidate because project 0e7da995a6824d13a03f152dc451a0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:35:58.518249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.518969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.520747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1045/2066] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:58 2022] DELETE /identity/v3/projects/0e7da995a6824d13a03f152dc451a0dc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:58.524744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.526220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:58.540732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c512b-485c-48a2-ab63-5ec13651d244 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.545561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.546190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.546479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.547310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] PATH_INFO: `/v3/users/40ac517b6b5842e0a5ac856b2ef4dfb6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.548573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ac517b6b5842e0a5ac856b2ef4dfb6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.550607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.627281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1022/2067] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:35:58 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:35:58.631103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.633010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:58.645723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cebb5-d56a-4c92-961e-9de39ea24293 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.650629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.651254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.651566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.651843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.652495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.654091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.665929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1023/2068] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:58.670055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.681070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5657a-7678-4d61-8e4a-f0ccdefde147 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.686081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.686738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.687019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.687355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] PATH_INFO: `/v3/projects/e3bcb0b8dbdd41868cb9cab1d26cc9c3/users/804b90e41a4f489cb50253acf6f99f67/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.702711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcb0b8dbdd41868cb9cab1d26cc9c3, user_id=804b90e41a4f489cb50253acf6f99f67, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.705716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.796146 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1024/2069] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:58 2022] PUT /identity/v3/projects/e3bcb0b8dbdd41868cb9cab1d26cc9c3/users/804b90e41a4f489cb50253acf6f99f67/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:58.800113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.864323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b101706-2aae-416d-94ee-45d55361d71f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.867335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ac517b6b5842e0a5ac856b2ef4dfb6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.868028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ac517b6b5842e0a5ac856b2ef4dfb6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.869092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.869692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.869965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.870234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.870868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.872481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.876186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ac517b6b5842e0a5ac856b2ef4dfb6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.883310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:58.888235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1025/2070] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:35:58.889287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:58.893011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:58.896469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ac517b6b5842e0a5ac856b2ef4dfb6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:58.908175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4625ab9-b56e-4e03-b985-3817717e147d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:58.913380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d33a4c-4c67-4cb7-bc8e-0e06e070478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:58.918075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33a4c-4c67-4cb7-bc8e-0e06e070478e admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.918075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33a4c-4c67-4cb7-bc8e-0e06e070478e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.918075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d33a4c-4c67-4cb7-bc8e-0e06e070478e admin admin] PATH_INFO: `/v3/projects/e3bcb0b8dbdd41868cb9cab1d26cc9c3/users/804b90e41a4f489cb50253acf6f99f67/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.918075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33a4c-4c67-4cb7-bc8e-0e06e070478e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcb0b8dbdd41868cb9cab1d26cc9c3, user_id=804b90e41a4f489cb50253acf6f99f67, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:58.919767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d33a4c-4c67-4cb7-bc8e-0e06e070478e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:58.932119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1026/2071] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:35:58 2022] PUT /identity/v3/projects/e3bcb0b8dbdd41868cb9cab1d26cc9c3/users/804b90e41a4f489cb50253acf6f99f67/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:35:58.943020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:58.943374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:58.946713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:58.972623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] MFA Rules not processed for user `804b90e41a4f489cb50253acf6f99f67`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:35:58.977597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:58.998315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ac517b6b5842e0a5ac856b2ef4dfb6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:59.010908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1046/2072] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:58 2022] DELETE /identity/v3/users/40ac517b6b5842e0a5ac856b2ef4dfb6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:35:59.054983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1027/2073] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:35:59.079704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:59.081544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:59.142984 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cf57f-c4a1-4649-99eb-4c0a7800b704 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:59.146735 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:59.147364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:59.147660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:59.147936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:59.207983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:59.209491 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:59.218888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1047/2074] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:35:59.499155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:59.500960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:59.503183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:59.504701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:59.519769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b1a3c-f9ae-4348-a877-82172ad47bf4 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:59.524371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:59.525154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:59.525585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:59.526646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:59.528751 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:59.594333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b7af-6318-41cd-9764-74badafeabde None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:59.620499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:59.621946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:59.631639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1048/2075] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:35:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:35:59.632512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:35:59.633841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:35:59.661303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:59.661958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:59.662269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:59.662543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] PATH_INFO: `/v3/users/6ab2004827d74bee839bbf54f0726f3e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:59.663841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab2004827d74bee839bbf54f0726f3e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:59.665808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:59.676828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:35:59.714130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68e5fc-eef9-4bc2-989c-f3c27b8a05a0 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:35:59.719003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:35:59.719670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:35:59.719946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:35:59.720219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] PATH_INFO: `/v3/projects/ef18155e2ddb4f33a5e4affb449ca8e1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:35:59.721377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef18155e2ddb4f33a5e4affb449ca8e1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:35:59.723261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:35:59.974901 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab2004827d74bee839bbf54f0726f3e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:35:59.975533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef18155e2ddb4f33a5e4affb449ca8e1', 'request_id': 'req-63f25851-5e5d-4637-ac97-1c3bf04c1af2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.058797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab2004827d74bee839bbf54f0726f3e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.071857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab2004827d74bee839bbf54f0726f3e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.072564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab2004827d74bee839bbf54f0726f3e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.079794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8eb54fac-7f88-4099-83c7-d942dc17b67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab2004827d74bee839bbf54f0726f3e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.085814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1028/2076] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:35:59 2022] DELETE /identity/v3/users/6ab2004827d74bee839bbf54f0726f3e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:00.090190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.090484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.090768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.112939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:00.114230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:00.154412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef18155e2ddb4f33a5e4affb449ca8e1', 'request_id': 'req-63f25851-5e5d-4637-ac97-1c3bf04c1af2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.161098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef18155e2ddb4f33a5e4affb449ca8e1', 'request_id': 'req-63f25851-5e5d-4637-ac97-1c3bf04c1af2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.173018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] The token cache is being invalidate because project ef18155e2ddb4f33a5e4affb449ca8e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:00.173523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.174345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-63f25851-5e5d-4637-ac97-1c3bf04c1af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:00.175977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1049/2077] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:35:59 2022] DELETE /identity/v3/projects/ef18155e2ddb4f33a5e4affb449ca8e1 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:00.180923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1029/2078] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:00.182386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c9982-bfd0-4213-acce-78e815bb55c8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.182676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c9982-bfd0-4213-acce-78e815bb55c8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.182953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c9982-bfd0-4213-acce-78e815bb55c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.189103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.190516 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:00.203693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fc2c9982-bfd0-4213-acce-78e815bb55c8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:00.204916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fc2c9982-bfd0-4213-acce-78e815bb55c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:00.213066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1050/2079] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:00.222028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bc7d-d93e-493d-9628-f358eeb91c8e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.222421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bc7d-d93e-493d-9628-f358eeb91c8e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.222720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799bc7d-d93e-493d-9628-f358eeb91c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.247641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d799bc7d-d93e-493d-9628-f358eeb91c8e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:00.249074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d799bc7d-d93e-493d-9628-f358eeb91c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:00.249401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22788628-2d3d-4985-a5ce-00c765faf22e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.254587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.255210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.255526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.256350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.266120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1051/2080] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:00.269037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799bc7d-d93e-493d-9628-f358eeb91c8e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.269912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.272749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.280238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799bc7d-d93e-493d-9628-f358eeb91c8e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.288078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1030/2081] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:00.289894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.290519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.290794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.297684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.297684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:00.297684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.297684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.309094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1052/2082] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:36:00.314449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.324107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ad73e-48e3-48f2-9e2c-50767b3113d9 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.329167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.329774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.330048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.330315 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.330954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.332920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.408260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:00.489730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1031/2083] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:00 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:00.493753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.503902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8218034-220b-4d76-b633-6becb3ad0603 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.572310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.572310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.572310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.572310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.573087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.573087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.696565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1053/2084] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:00 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:00.700363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.711924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc1ac-8613-4178-af48-04a12edf477b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.717743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.718537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.719932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.720937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.720937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.722661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.737566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1032/2085] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:00.742700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.753290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26812726-c619-448b-a447-fb2942626f1b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.758478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.759139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.761499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.761499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.761499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.762421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.777969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1054/2086] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:00.778950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.790151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc34a0-2df7-415a-8eb7-ab1a66deae05 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.795530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee547b-06fb-40ff-86b1-aac75f2fad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.796208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee547b-06fb-40ff-86b1-aac75f2fad52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.796486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee547b-06fb-40ff-86b1-aac75f2fad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.796950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee547b-06fb-40ff-86b1-aac75f2fad52 admin admin] PATH_INFO: `/v3/projects/959e3f7abc1d4a52bc2a2c1ebcc5037e/users/11a7593e22c5495da5e4dccb342435a3/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.812700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee547b-06fb-40ff-86b1-aac75f2fad52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959e3f7abc1d4a52bc2a2c1ebcc5037e, user_id=11a7593e22c5495da5e4dccb342435a3, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.815547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee547b-06fb-40ff-86b1-aac75f2fad52 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.829781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:00.832113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:00.846746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d75c83-9423-4dc6-84a2-2e12c25857ee admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:00.852136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:00.853090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.853436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.853799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] PATH_INFO: `/v3/projects/2cfcc8f7fc704021b49546f06178df56` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.855025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cfcc8f7fc704021b49546f06178df56)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:00.857321 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:00.955629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1033/2087] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:00 2022] PUT /identity/v3/projects/959e3f7abc1d4a52bc2a2c1ebcc5037e/users/11a7593e22c5495da5e4dccb342435a3/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:00.966505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110898d-9a02-45d5-86c0-e94d53ccfb33 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:00.966695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110898d-9a02-45d5-86c0-e94d53ccfb33 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:00.966947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110898d-9a02-45d5-86c0-e94d53ccfb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:00.996697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c110898d-9a02-45d5-86c0-e94d53ccfb33 None None] MFA Rules not processed for user `11a7593e22c5495da5e4dccb342435a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:00.997935 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c110898d-9a02-45d5-86c0-e94d53ccfb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.000697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cfcc8f7fc704021b49546f06178df56', 'request_id': 'req-8f488bd3-3298-48ec-b215-32ec39070854'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.070097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1034/2088] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:01.070097 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110898d-9a02-45d5-86c0-e94d53ccfb33 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.086936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cfcc8f7fc704021b49546f06178df56', 'request_id': 'req-8f488bd3-3298-48ec-b215-32ec39070854'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.094038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cfcc8f7fc704021b49546f06178df56', 'request_id': 'req-8f488bd3-3298-48ec-b215-32ec39070854'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.106104 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] The token cache is being invalidate because project 2cfcc8f7fc704021b49546f06178df56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:01.106400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.107110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8f488bd3-3298-48ec-b215-32ec39070854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.109669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1055/2089] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:00 2022] DELETE /identity/v3/projects/2cfcc8f7fc704021b49546f06178df56 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:01.114759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f454e-d4a7-4a8a-8813-0bdd96e3c392 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.115057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f454e-d4a7-4a8a-8813-0bdd96e3c392 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.115362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f454e-d4a7-4a8a-8813-0bdd96e3c392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.136090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-462f454e-d4a7-4a8a-8813-0bdd96e3c392 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:01.137325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-462f454e-d4a7-4a8a-8813-0bdd96e3c392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.141196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110898d-9a02-45d5-86c0-e94d53ccfb33 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.145938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.146662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1056/2090] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:01.146776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.146856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.147108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.147825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.149739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.154166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6965426-0054-4a79-952a-bac3c6e30d8a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.154652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6965426-0054-4a79-952a-bac3c6e30d8a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.154784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6965426-0054-4a79-952a-bac3c6e30d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.176240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c6965426-0054-4a79-952a-bac3c6e30d8a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:01.177467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c6965426-0054-4a79-952a-bac3c6e30d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.185669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1057/2091] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:01.190378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6965426-0054-4a79-952a-bac3c6e30d8a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.199258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6965426-0054-4a79-952a-bac3c6e30d8a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.203862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.204448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.204723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.204990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.205628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:01.205975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.207528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.225303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1058/2092] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:36:01.225303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.225303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.239506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1035/2093] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:01 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:01.239684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7ffd-7632-4af1-a725-fe73c2108065 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.245126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.295150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.295815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.296093 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.296367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] PATH_INFO: `/v3/users/38d670febffb45d8968988ae6e9790cd` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.298284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d670febffb45d8968988ae6e9790cd)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.303109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.304384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a716508-ef09-4572-b509-7c8e2439060d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.308463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.309072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.309339 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.309615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.310249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.312255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.402886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1036/2094] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:01 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:01.403847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.405615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.471506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7c5c-bdcc-442f-b3ef-b628f17cbd87 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.477254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.477254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.477254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.479836 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.479836 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.480083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.514455 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d670febffb45d8968988ae6e9790cd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.515300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d670febffb45d8968988ae6e9790cd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.522474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d670febffb45d8968988ae6e9790cd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.542330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d670febffb45d8968988ae6e9790cd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.613764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1037/2095] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:01 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:01.614580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.616221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.629150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f7e9-fa74-4986-a31a-fb0154cecd9c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.633807 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c818c7-70dc-4e42-92a7-95d9e05301e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.634397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c818c7-70dc-4e42-92a7-95d9e05301e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.634683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c818c7-70dc-4e42-92a7-95d9e05301e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.634955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c818c7-70dc-4e42-92a7-95d9e05301e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.635861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c818c7-70dc-4e42-92a7-95d9e05301e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.637771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c818c7-70dc-4e42-92a7-95d9e05301e1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.670063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d670febffb45d8968988ae6e9790cd'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:01.677630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1059/2096] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:01 2022] DELETE /identity/v3/users/38d670febffb45d8968988ae6e9790cd => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:01.678445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.679991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.756164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c20c40-a730-4637-b758-6d9d50b2f0fa admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.767967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.767967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.767967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.768240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1038/2097] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:01 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:01.768317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.768317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.768451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30cacb-e800-4074-ba9b-2d43a728adbd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.768451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30cacb-e800-4074-ba9b-2d43a728adbd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.768451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30cacb-e800-4074-ba9b-2d43a728adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.769076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.780720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1060/2098] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:01.782297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.793615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-af30cacb-e800-4074-ba9b-2d43a728adbd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:01.795059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af30cacb-e800-4074-ba9b-2d43a728adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.799598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555394cc-ce6f-4828-9aba-00f6b7ef89b1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.805505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1039/2099] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:01.808579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30cacb-e800-4074-ba9b-2d43a728adbd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.809640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.810253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.810533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.811440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.812304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.814172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.820991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30cacb-e800-4074-ba9b-2d43a728adbd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.825975 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1061/2100] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:01.831215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.831494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.831646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.831646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.831646 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.831877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:01.831952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.833717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.845413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1040/2101] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:01.846294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.857732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150214eb-9791-407a-adb3-44cd75f3ab4e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.863947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.864553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.864898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.865095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.865737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.867415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.879670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1041/2102] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:01.880611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.893848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713487b-18fe-4352-87a5-a6bae18a8bf4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.900717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ec881-e3ad-4d5c-80e6-074463a80f6d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.902247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28913-c99a-4ff8-b5f1-28e3a6020215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.902982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28913-c99a-4ff8-b5f1-28e3a6020215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.903252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28913-c99a-4ff8-b5f1-28e3a6020215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.903562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28913-c99a-4ff8-b5f1-28e3a6020215 admin admin] PATH_INFO: `/v3/projects/978f62194f1c4ccd8e54758aab666a84/users/1586dadc6f094c019190ee7362d1c3bf/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.905401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.906629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.907059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.907649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.918800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.920943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.923950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28913-c99a-4ff8-b5f1-28e3a6020215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978f62194f1c4ccd8e54758aab666a84, user_id=1586dadc6f094c019190ee7362d1c3bf, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.928547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f28913-c99a-4ff8-b5f1-28e3a6020215 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:01.932979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1062/2103] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:01.934418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:01.944103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126921c8-ca41-431a-8410-70aae73ad3ae service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:01.948978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dddf75-56a6-4704-87f3-4f8ce05aea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:01.949662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dddf75-56a6-4704-87f3-4f8ce05aea93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:01.949930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dddf75-56a6-4704-87f3-4f8ce05aea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:01.950209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dddf75-56a6-4704-87f3-4f8ce05aea93 admin admin] PATH_INFO: `/v3/projects/576436be7c1d459ba5c2f854768973ab/users/6666a5d0fee44372801adb6effbf0b0c/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:01.980317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dddf75-56a6-4704-87f3-4f8ce05aea93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576436be7c1d459ba5c2f854768973ab, user_id=6666a5d0fee44372801adb6effbf0b0c, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:01.982988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dddf75-56a6-4704-87f3-4f8ce05aea93 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:02.099834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1042/2104] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:01 2022] PUT /identity/v3/projects/978f62194f1c4ccd8e54758aab666a84/users/1586dadc6f094c019190ee7362d1c3bf/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:02.110840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55aad3-347a-40bc-b9d7-3d14a47c8ed4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.111125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55aad3-347a-40bc-b9d7-3d14a47c8ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.111430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55aad3-347a-40bc-b9d7-3d14a47c8ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.139895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1063/2105] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:01 2022] PUT /identity/v3/projects/576436be7c1d459ba5c2f854768973ab/users/6666a5d0fee44372801adb6effbf0b0c/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:02.144725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ad55aad3-347a-40bc-b9d7-3d14a47c8ed4 None None] MFA Rules not processed for user `1586dadc6f094c019190ee7362d1c3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:02.145753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234b83-d3fd-44af-a1a7-8e40fe1af5e3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.146001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ad55aad3-347a-40bc-b9d7-3d14a47c8ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:02.146132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234b83-d3fd-44af-a1a7-8e40fe1af5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.146442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7234b83-d3fd-44af-a1a7-8e40fe1af5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.169845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c7234b83-d3fd-44af-a1a7-8e40fe1af5e3 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:02.171454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c7234b83-d3fd-44af-a1a7-8e40fe1af5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:02.234245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1043/2106] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:02.238833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55aad3-347a-40bc-b9d7-3d14a47c8ed4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:02.243649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1064/2107] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:02.250345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7234b83-d3fd-44af-a1a7-8e40fe1af5e3 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:02.251070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55aad3-347a-40bc-b9d7-3d14a47c8ed4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:02.256452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:02.256639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.261350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.261350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.261350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:02.261350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:02.312051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7234b83-d3fd-44af-a1a7-8e40fe1af5e3 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:02.316454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:02.317061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.317340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.317617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.326793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:02.329243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:02.338727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1065/2108] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:02.424952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:02.426543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:02.438450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1044/2109] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:02 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:02.441472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37aaff-5147-4185-a1b2-44abe353eee1 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:02.442476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:02.506813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:02.507616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.507901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.513710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] PATH_INFO: `/v3/projects/d50419e7964348b9a1fc190cd6de02d2` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.513710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50419e7964348b9a1fc190cd6de02d2)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:02.513710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:02.518618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f46667-65f8-45f2-ac2d-7d44aec1c56d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:02.523722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:02.524421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.524779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.525124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.526110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:02.528223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:02.535533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:02.707896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1045/2110] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:02 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:02.707896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:02.709662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:02.721978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50419e7964348b9a1fc190cd6de02d2', 'request_id': 'req-c8af57f6-23ea-4e11-b4dc-e802b3901a79'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:02.723026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715069f-be91-4d72-89be-5fadb2178948 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:02.802690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:02.803360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.806786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.806786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] PATH_INFO: `/v3/users/e5d500eb8f884ffc96d02b1fd2de5767` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.806786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d500eb8f884ffc96d02b1fd2de5767)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:02.807604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:02.858582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50419e7964348b9a1fc190cd6de02d2', 'request_id': 'req-c8af57f6-23ea-4e11-b4dc-e802b3901a79'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:02.866063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50419e7964348b9a1fc190cd6de02d2', 'request_id': 'req-c8af57f6-23ea-4e11-b4dc-e802b3901a79'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:02.878021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] The token cache is being invalidate because project d50419e7964348b9a1fc190cd6de02d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:02.878314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:02.879011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:02.880579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1066/2111] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:02 2022] DELETE /identity/v3/projects/d50419e7964348b9a1fc190cd6de02d2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:02.881420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:02.882726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:02.895575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af57f6-23ea-4e11-b4dc-e802b3901a79 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:02.900347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:02.900951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.901232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.901503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.902151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:02.903801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:02.914537 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1067/2112] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:02.915562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:02.920138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:02.932651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7c42b-4dae-4501-8062-54f9c7bd7b28 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:02.937415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:02.938041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:02.938322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:02.938634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] PATH_INFO: `/v3/users/bd377dbd8f9b4aa1ad43e17ea2cf6064` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:02.940662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd377dbd8f9b4aa1ad43e17ea2cf6064)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:02.942591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:03.103403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d500eb8f884ffc96d02b1fd2de5767'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.189908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d500eb8f884ffc96d02b1fd2de5767'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.205002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d500eb8f884ffc96d02b1fd2de5767'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.205864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d500eb8f884ffc96d02b1fd2de5767'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.207385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd377dbd8f9b4aa1ad43e17ea2cf6064'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.208455 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd377dbd8f9b4aa1ad43e17ea2cf6064'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.213782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d500eb8f884ffc96d02b1fd2de5767'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.215820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd377dbd8f9b4aa1ad43e17ea2cf6064'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.221645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1046/2113] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:02 2022] DELETE /identity/v3/users/e5d500eb8f884ffc96d02b1fd2de5767 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:03.222342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:03.223890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:03.230744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd377dbd8f9b4aa1ad43e17ea2cf6064'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.289805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18141b-5714-45f0-90a1-9d842bf538d8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:03.295285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:03.295998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:03.296353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:03.296702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] PATH_INFO: `/v3/projects/e14bda9c01374951b99ec43c7e57834e/users/b899dd087233477caadf62d650bbfdb0/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:03.317724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14bda9c01374951b99ec43c7e57834e, user_id=b899dd087233477caadf62d650bbfdb0, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:03.324923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:03.342951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-8d751887-0aeb-4628-87ad-ef9e03516fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd377dbd8f9b4aa1ad43e17ea2cf6064'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:03.350385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1068/2114] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:02 2022] DELETE /identity/v3/users/bd377dbd8f9b4aa1ad43e17ea2cf6064 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:03.351648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:03.354427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:03.354427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:03.372741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:03.374028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:03.434788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1069/2115] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:03.444841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:03.446224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:03.481256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1047/2116] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:03 2022] PUT /identity/v3/projects/e14bda9c01374951b99ec43c7e57834e/users/b899dd087233477caadf62d650bbfdb0/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:03.485693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:03.493200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:03.506888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:03.522997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62251-d78d-42e5-8bbf-8177ad0ddd17 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:03.568354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e7bc9-0be1-4f1d-98f1-742a4db1456f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:03.573425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:03.574136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:03.574490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:03.574833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:03.574925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66c0c8-500c-408a-8eae-2a5cf0fe98b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:03.575535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c0c8-500c-408a-8eae-2a5cf0fe98b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:03.575631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:03.575818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c0c8-500c-408a-8eae-2a5cf0fe98b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:03.576091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c0c8-500c-408a-8eae-2a5cf0fe98b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:03.577201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:03.588142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66c0c8-500c-408a-8eae-2a5cf0fe98b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:03.588493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66c0c8-500c-408a-8eae-2a5cf0fe98b9 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:03.588805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1048/2117] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:03.593073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:03.603618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1070/2118] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:03.606034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a91be-3273-4ebf-9063-95b95a9a2a13 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:03.612419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:03.618167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:03.618397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:03.623248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] PATH_INFO: `/v3/projects/e14bda9c01374951b99ec43c7e57834e/users/b899dd087233477caadf62d650bbfdb0/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:03.623248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14bda9c01374951b99ec43c7e57834e, user_id=b899dd087233477caadf62d650bbfdb0, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:03.625120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:03.640008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1049/2119] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:03 2022] PUT /identity/v3/projects/e14bda9c01374951b99ec43c7e57834e/users/b899dd087233477caadf62d650bbfdb0/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:03.650407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:03.650694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:03.651254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:03.685296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] MFA Rules not processed for user `b899dd087233477caadf62d650bbfdb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:03.686523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:03.806623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1071/2120] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:03.819750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:03.821514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:03.887469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31113e-89b7-4300-95ba-d4e8927eb90f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:03.893265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa69236-1f76-49f1-baad-9043a4cd7bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:03.893815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69236-1f76-49f1-baad-9043a4cd7bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:03.894092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69236-1f76-49f1-baad-9043a4cd7bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:03.894366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69236-1f76-49f1-baad-9043a4cd7bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:03.896295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5fa69236-1f76-49f1-baad-9043a4cd7bb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:03.976955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa69236-1f76-49f1-baad-9043a4cd7bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:03.978578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa69236-1f76-49f1-baad-9043a4cd7bb4 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:03.989767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1050/2121] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:04.004697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:04.006489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:04.116086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779c0f0-97e1-4d68-b87d-77198817bfbf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:04.124943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:04.125915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:04.128023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:04.143968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] PATH_INFO: `/v3/projects/698a3c8b406e4875b7fac73a06d3db98` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:04.149105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698a3c8b406e4875b7fac73a06d3db98)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:04.151385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:04.324924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698a3c8b406e4875b7fac73a06d3db98', 'request_id': 'req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.442264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698a3c8b406e4875b7fac73a06d3db98', 'request_id': 'req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.448880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698a3c8b406e4875b7fac73a06d3db98', 'request_id': 'req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.461457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] The token cache is being invalidate because project 698a3c8b406e4875b7fac73a06d3db98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:04.461750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.462482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.464075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1072/2122] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:04 2022] DELETE /identity/v3/projects/698a3c8b406e4875b7fac73a06d3db98 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:04.469460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da84a2-8dae-4084-bbfb-bf0989974c66 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:04.469460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da84a2-8dae-4084-bbfb-bf0989974c66 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:04.470610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da84a2-8dae-4084-bbfb-bf0989974c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:04.489888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-97da84a2-8dae-4084-bbfb-bf0989974c66 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:04.491134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-97da84a2-8dae-4084-bbfb-bf0989974c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:04.510962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:04.516652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:04.574239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1051/2123] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:04.583390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115415b7-cc9d-457c-9dd5-cee9e03dc2ea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:04.584276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115415b7-cc9d-457c-9dd5-cee9e03dc2ea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:04.584276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115415b7-cc9d-457c-9dd5-cee9e03dc2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:04.608145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02c9a3-e19e-4ae3-8449-c4ba58da0508 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:04.613072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-115415b7-cc9d-457c-9dd5-cee9e03dc2ea None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:04.613072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-115415b7-cc9d-457c-9dd5-cee9e03dc2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:04.614128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:04.614958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:04.615303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:04.615696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] PATH_INFO: `/v3/projects/9ada444812e84d068b6efc4ec8108bfa` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:04.617136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ada444812e84d068b6efc4ec8108bfa)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:04.619248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:04.623256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1052/2124] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:04.628277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115415b7-cc9d-457c-9dd5-cee9e03dc2ea None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:04.638871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115415b7-cc9d-457c-9dd5-cee9e03dc2ea None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:04.645856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:04.646639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:04.647272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:04.647446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:04.648310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:04.648715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:04.650616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:04.667027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1053/2125] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:36:04.671559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:04.682569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12100a-ddeb-46c9-a13d-a6c9bbcf5fb4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:04.688305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:04.689928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:04.690380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:04.691651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:04.692358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:04.694471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:04.815763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1054/2126] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:04 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:04.819972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:04.843604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ada444812e84d068b6efc4ec8108bfa', 'request_id': 'req-5692286d-2c37-43b0-a109-4e64bf6416f9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.921288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ba82-bf40-4ddd-ac54-5d255d5e7d14 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:04.956454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ada444812e84d068b6efc4ec8108bfa', 'request_id': 'req-5692286d-2c37-43b0-a109-4e64bf6416f9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.963960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ada444812e84d068b6efc4ec8108bfa', 'request_id': 'req-5692286d-2c37-43b0-a109-4e64bf6416f9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.980299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] The token cache is being invalidate because project 9ada444812e84d068b6efc4ec8108bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:04.980905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.981728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:04.984806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1073/2127] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:04 2022] DELETE /identity/v3/projects/9ada444812e84d068b6efc4ec8108bfa => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:04.991064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:04.991064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:05.043748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:05.044834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:05.045255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:05.045715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:05.046364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:05.048798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:05.083263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692286d-2c37-43b0-a109-4e64bf6416f9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:05.088368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:05.088999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:05.089282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:05.089647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] PATH_INFO: `/v3/users/798e285356c64d619ec85c1a25875506` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:05.090841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798e285356c64d619ec85c1a25875506)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:05.092853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:05.163976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1055/2128] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:04 2022] POST /identity/v3/users => generated 284 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:05.168018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:05.170546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:05.184164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e141a7-082d-4c7f-8dd5-6d31ea166300 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:05.191535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:05.192258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:05.192965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:05.192965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:05.193666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:05.195462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:05.214263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1056/2129] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:05.215518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:05.227638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702e261-087c-4dd5-96f7-714df83f8103 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:05.233118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:05.233760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:05.234016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:05.234298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:05.235098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:05.238375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:05.253706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1057/2130] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:05.257007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:05.269484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed8fd3-b197-4261-b61f-8112e7534a96 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:05.276309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e738ef-8a32-447d-aced-073376d6cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:05.277143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e738ef-8a32-447d-aced-073376d6cfd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:05.277432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e738ef-8a32-447d-aced-073376d6cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:05.278811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e738ef-8a32-447d-aced-073376d6cfd4 admin admin] PATH_INFO: `/v3/projects/9f481e9bbc2b480a8d5ae2ea9f50a2c2/users/c189fc14d9df44cab786e6b833d961cf/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:05.296799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e738ef-8a32-447d-aced-073376d6cfd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f481e9bbc2b480a8d5ae2ea9f50a2c2, user_id=c189fc14d9df44cab786e6b833d961cf, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:05.299968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e738ef-8a32-447d-aced-073376d6cfd4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:05.374127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798e285356c64d619ec85c1a25875506'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:05.375498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798e285356c64d619ec85c1a25875506'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:05.384389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798e285356c64d619ec85c1a25875506'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:05.398696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798e285356c64d619ec85c1a25875506'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:05.403135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1058/2131] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:05 2022] PUT /identity/v3/projects/9f481e9bbc2b480a8d5ae2ea9f50a2c2/users/c189fc14d9df44cab786e6b833d961cf/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:05.415290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:05.415806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:05.416167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:05.453046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] MFA Rules not processed for user `c189fc14d9df44cab786e6b833d961cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:05.454250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:05.529867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1059/2132] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:05.530450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798e285356c64d619ec85c1a25875506'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:05.541988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1074/2133] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:04 2022] DELETE /identity/v3/users/798e285356c64d619ec85c1a25875506 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:05.543978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:05.546425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:05.693409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ce41d-834d-40f7-a87b-81853bb5665c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:05.773966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:05.773966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:05.773966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:05.773966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:05.774361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:05.774361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:05.988518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1060/2134] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:05 2022] POST /identity/v3/projects => generated 367 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:05.993232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:06.006406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d19e9-890d-440c-8702-9b1fee962da1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:06.124981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:06.126696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:06.127136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:06.127723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:06.128773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:06.131294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:06.294466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1075/2135] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:05 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:06.294833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:06.306925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8592c-765a-4e0e-9833-8ba1bf513adc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:06.313181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:06.314600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:06.315197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:06.315616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:06.316473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:06.318484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:06.333546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1061/2136] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:06.337448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:06.351210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d8e24-505b-4ccd-b643-f0d0dc4a9c92 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:06.358978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:06.359926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:06.360985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:06.361521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] PATH_INFO: `/v3/projects/3b84216769a4470896b29cbfca0d3dbf/users/3002171301ae44588b0ec1ffc2805dda/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:06.382623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b84216769a4470896b29cbfca0d3dbf, user_id=3002171301ae44588b0ec1ffc2805dda, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:06.387117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:06.471108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1076/2137] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:06 2022] PUT /identity/v3/projects/3b84216769a4470896b29cbfca0d3dbf/users/3002171301ae44588b0ec1ffc2805dda/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:06.477004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:06.494832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9cb70-44a5-4ecf-ba49-4328d58a6cf3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:06.567032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:DELETE=1,keystone:INSERT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:06.599200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f436a-35e9-4cea-af40-d4947f523620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:06.600174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f436a-35e9-4cea-af40-d4947f523620 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:06.600453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f436a-35e9-4cea-af40-d4947f523620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:06.600802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f436a-35e9-4cea-af40-d4947f523620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:06.601546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f436a-35e9-4cea-af40-d4947f523620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:06.606204 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f436a-35e9-4cea-af40-d4947f523620 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:06.619496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1062/2138] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:06.624080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:06.639212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828f4c-6ff5-4950-90ef-834957093f4b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:06.641344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:06.642866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:06.643122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:06.643438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] PATH_INFO: `/v3/projects/3b84216769a4470896b29cbfca0d3dbf/users/3002171301ae44588b0ec1ffc2805dda/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:06.646507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b84216769a4470896b29cbfca0d3dbf, user_id=3002171301ae44588b0ec1ffc2805dda, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:06.650842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:06.668633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1077/2139] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:06 2022] PUT /identity/v3/projects/3b84216769a4470896b29cbfca0d3dbf/users/3002171301ae44588b0ec1ffc2805dda/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:06.683760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:06.684956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:06.684956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:06.733354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] MFA Rules not processed for user `3002171301ae44588b0ec1ffc2805dda`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:06.736657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:06.843873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1063/2140] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:06.853169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:06.855161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:06.953066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:06.955062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:07.004258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ad20c-44cc-40e6-bb55-722757cbb9d1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:07.009926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:07.010729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:07.011022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:07.011379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:07.030435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:07.031265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:07.047163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1078/2141] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:07.113145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afabe5-1418-4762-94b4-a869070fd135 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:07.118955 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:07.119359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:07.119736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:07.120011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] PATH_INFO: `/v3/projects/c54a2fa413534457bb07fa802dbd0a12` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:07.121188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54a2fa413534457bb07fa802dbd0a12)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:07.123699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:07.353154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54a2fa413534457bb07fa802dbd0a12', 'request_id': 'req-7e5885a1-435c-4675-bc56-881a5d30448d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:07.458751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54a2fa413534457bb07fa802dbd0a12', 'request_id': 'req-7e5885a1-435c-4675-bc56-881a5d30448d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:07.459562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:07.471091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54a2fa413534457bb07fa802dbd0a12', 'request_id': 'req-7e5885a1-435c-4675-bc56-881a5d30448d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:07.483244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] The token cache is being invalidate because project c54a2fa413534457bb07fa802dbd0a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:07.484099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:07.485048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:07.488559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1064/2142] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:06 2022] DELETE /identity/v3/projects/c54a2fa413534457bb07fa802dbd0a12 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:07.492530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:07.509622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26194945-8740-4bb6-b10d-63d3b5c8cc9d service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:07.527464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:07.529253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:07.616863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:07.617531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:07.617814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:07.618090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] PATH_INFO: `/v3/users/da899b7cc9f34fa6a3e8bf9cf5ce1cfc` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:07.636516 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da899b7cc9f34fa6a3e8bf9cf5ce1cfc)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:07.637190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5885a1-435c-4675-bc56-881a5d30448d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:07.639032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:07.645609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:07.655276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:07.655276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:07.655276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:07.655276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:07.755025 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:07.756712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:07.770265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1065/2143] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:07.999547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da899b7cc9f34fa6a3e8bf9cf5ce1cfc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:08.000249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da899b7cc9f34fa6a3e8bf9cf5ce1cfc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:08.014421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da899b7cc9f34fa6a3e8bf9cf5ce1cfc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:08.059434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da899b7cc9f34fa6a3e8bf9cf5ce1cfc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:08.205258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da899b7cc9f34fa6a3e8bf9cf5ce1cfc'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:08.224470 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1079/2144] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:07 2022] DELETE /identity/v3/users/da899b7cc9f34fa6a3e8bf9cf5ce1cfc => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:08.785524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:08.787092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:08.800827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c514d95-8ee5-4ad7-9177-6fd5203fb09e service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:08.879840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0846-1e45-44be-ae96-20b1ed62f795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:08.880554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0846-1e45-44be-ae96-20b1ed62f795 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:08.880914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0846-1e45-44be-ae96-20b1ed62f795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:08.881376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0846-1e45-44be-ae96-20b1ed62f795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:08.883517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b41d0846-1e45-44be-ae96-20b1ed62f795 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:08.986775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:08.988387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:09.026191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d0846-1e45-44be-ae96-20b1ed62f795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:09.028446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d0846-1e45-44be-ae96-20b1ed62f795 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:09.055039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1066/2145] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:09.118312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6d29b-bee2-4a48-b109-a07a1dbca86b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:09.132732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:09.132732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:09.132732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:09.132732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] PATH_INFO: `/v3/projects/599c742737a84110b008af9fbca83ce8` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:09.133343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] RBAC: Authorizing `identity:delete_project(project_id=599c742737a84110b008af9fbca83ce8)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:09.134268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:09.358944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599c742737a84110b008af9fbca83ce8', 'request_id': 'req-483e7b44-ece7-4c8b-860e-428c98cab13d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:09.423855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599c742737a84110b008af9fbca83ce8', 'request_id': 'req-483e7b44-ece7-4c8b-860e-428c98cab13d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:09.430628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599c742737a84110b008af9fbca83ce8', 'request_id': 'req-483e7b44-ece7-4c8b-860e-428c98cab13d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:09.445157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] The token cache is being invalidate because project 599c742737a84110b008af9fbca83ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:09.445457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:09.446134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-483e7b44-ece7-4c8b-860e-428c98cab13d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:09.448143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1080/2146] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:08 2022] DELETE /identity/v3/projects/599c742737a84110b008af9fbca83ce8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:09.454427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3caad-955f-40ff-8b3c-4c87afe9114e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:09.454721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3caad-955f-40ff-8b3c-4c87afe9114e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:09.455027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3caad-955f-40ff-8b3c-4c87afe9114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:09.479208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7da3caad-955f-40ff-8b3c-4c87afe9114e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:09.481379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7da3caad-955f-40ff-8b3c-4c87afe9114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:09.570130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1067/2147] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:09.579475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2e89-4075-4d71-92af-15fe6be34102 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:09.580037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2e89-4075-4d71-92af-15fe6be34102 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:09.580517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2e89-4075-4d71-92af-15fe6be34102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:09.603193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-85dd2e89-4075-4d71-92af-15fe6be34102 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:09.604899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-85dd2e89-4075-4d71-92af-15fe6be34102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:09.617017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1081/2148] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:09.621179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3caad-955f-40ff-8b3c-4c87afe9114e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:09.633525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3caad-955f-40ff-8b3c-4c87afe9114e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:09.642336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:09.643715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:09.644156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:09.644621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:09.645536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:09.645996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:09.647846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:09.670693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1068/2149] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:36:09.677032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2e89-4075-4d71-92af-15fe6be34102 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:09.700789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2e89-4075-4d71-92af-15fe6be34102 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:09.716317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70bd62-a952-4a7d-82dd-4f8e50d7216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:09.717307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70bd62-a952-4a7d-82dd-4f8e50d7216d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:09.717307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70bd62-a952-4a7d-82dd-4f8e50d7216d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:09.717509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70bd62-a952-4a7d-82dd-4f8e50d7216d admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:09.718161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70bd62-a952-4a7d-82dd-4f8e50d7216d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:09.721051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70bd62-a952-4a7d-82dd-4f8e50d7216d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:09.827152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:09.884705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1082/2150] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:09 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:09.890061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:09.902875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adb311-b833-4ee2-b855-5885373913b6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:09.995225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:09.996304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.001581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.001581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.001581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.001581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.036476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.036476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.036476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.074565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] MFA Rules not processed for user `6666a5d0fee44372801adb6effbf0b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:10.075662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1069/2151] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:09 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:10.076606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:10.081028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.093269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a081b-fcef-4a90-a15b-1682c44afa14 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.098675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.099460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.099754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.100029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.101352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.102974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.117014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1070/2152] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:10.121183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.132593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f289f-932f-4687-af66-a0fb413e0862 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.138163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.139014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.139309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.139616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.140527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.143440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.161161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1071/2153] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:10.162375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.165981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1083/2154] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:10.170330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.172469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:10.177883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa5e48-8378-48fc-82bd-1dfd8bee2d34 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.183535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72799b2e-2ad2-425c-a14b-551929d32ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.184330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799b2e-2ad2-425c-a14b-551929d32ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.184679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799b2e-2ad2-425c-a14b-551929d32ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.185115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799b2e-2ad2-425c-a14b-551929d32ad9 admin admin] PATH_INFO: `/v3/projects/7552b8d996c04ecd8ad0a49241404a59/users/592cfae4988647f3a3b3aa34ebbda57d/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.194202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b020f-5a4c-4ae8-9f50-7488e728f04f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.200874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.201138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.201598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.202190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.203094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.206538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.221802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72799b2e-2ad2-425c-a14b-551929d32ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7552b8d996c04ecd8ad0a49241404a59, user_id=592cfae4988647f3a3b3aa34ebbda57d, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.225152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72799b2e-2ad2-425c-a14b-551929d32ad9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.324377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1084/2155] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:10 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:10.326223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1072/2156] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:10 2022] PUT /identity/v3/projects/7552b8d996c04ecd8ad0a49241404a59/users/592cfae4988647f3a3b3aa34ebbda57d/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:10.328507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.343138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.343466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.346157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.387126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] MFA Rules not processed for user `592cfae4988647f3a3b3aa34ebbda57d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:10.388669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:10.424888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5bca-01e3-4506-99ac-b5f7e3bafcf0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.432043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.432665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.432933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.433212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.433868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.436074 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.472745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1073/2157] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:10.484523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.487863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:10.579261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872c7aa-7646-40c5-93fe-29095c7b9fcc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.583584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.584206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.584551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.587689 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.587811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1085/2158] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:10 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:10.589152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.595101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.596592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.599858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3417b-a6ce-4d5f-975e-6dae6180c6f1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.604552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.605525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.605811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.606079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.606210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1074/2159] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:10.606725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.608338 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.613362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:10.638347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1086/2160] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:10.642708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.656455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d299f5-eff9-4be3-9cf0-c7d47d6357a9 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.663399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.664139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.664471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.664783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] PATH_INFO: `/v3/projects/70f87d2a8cce41c2882dac97983d037a/users/999777b5f4c847199dfe865a85f6b962/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.685429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f87d2a8cce41c2882dac97983d037a, user_id=999777b5f4c847199dfe865a85f6b962, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.686262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.853207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:10.856816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1075/2161] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:10 2022] PUT /identity/v3/projects/70f87d2a8cce41c2882dac97983d037a/users/999777b5f4c847199dfe865a85f6b962/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:10.860846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.872577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4cdb2-3d3c-40a0-9453-478c64a824ba admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.932274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.932886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.933170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.933445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.934095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.935780 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:10.946670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1087/2162] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:10.951241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:10.964005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996eed1-a8ff-487e-895e-87bb5fdb7e32 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:10.969596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb30588-a469-47fb-9006-1ead600b272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:10.970784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30588-a469-47fb-9006-1ead600b272f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:10.971068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30588-a469-47fb-9006-1ead600b272f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:10.971332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30588-a469-47fb-9006-1ead600b272f admin admin] PATH_INFO: `/v3/projects/70f87d2a8cce41c2882dac97983d037a/users/999777b5f4c847199dfe865a85f6b962/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:10.973463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb30588-a469-47fb-9006-1ead600b272f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f87d2a8cce41c2882dac97983d037a, user_id=999777b5f4c847199dfe865a85f6b962, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:10.976541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb30588-a469-47fb-9006-1ead600b272f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:11.003061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1076/2163] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:10 2022] PUT /identity/v3/projects/70f87d2a8cce41c2882dac97983d037a/users/999777b5f4c847199dfe865a85f6b962/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:12.072655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:12.074595 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:12.159028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a148a3-1e09-49d6-8028-f962baf6c2ce admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:12.248640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:12.249255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:12.249533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:12.249803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:12.252458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:12.356878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:12.361025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:12.370109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1088/2164] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:13.443283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:13.804733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:17.829758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:18.110666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:18.722126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:18.724595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:18.724595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:18.767197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] MFA Rules not processed for user `999777b5f4c847199dfe865a85f6b962`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:18.775948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:18.894515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1077/2165] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:18.910367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:18.913671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:19.033648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7bd3e-7a85-4c3b-8b14-9e3d2b397978 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:19.037534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:19.038467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:19.038825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:19.039324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:19.112056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:19.113804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:19.123436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1089/2166] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:19.209569 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:19.215537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:19.286656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b4aeb-4bf6-48d1-82eb-132228b3ea61 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:19.294846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:19.295545 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:19.295938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:19.296081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] PATH_INFO: `/v3/users/c189fc14d9df44cab786e6b833d961cf` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:19.297273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c189fc14d9df44cab786e6b833d961cf)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:19.299795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:19.405857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:19.407452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:19.421352 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab33c-98f2-4937-91e7-265d8df962ea service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:19.426747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:19.427485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:19.427753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:19.428036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] PATH_INFO: `/v3/users/11a7593e22c5495da5e4dccb342435a3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:19.429215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a7593e22c5495da5e4dccb342435a3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:19.431138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:19.575611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c189fc14d9df44cab786e6b833d961cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.654100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c189fc14d9df44cab786e6b833d961cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.671085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a7593e22c5495da5e4dccb342435a3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.671796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a7593e22c5495da5e4dccb342435a3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.675573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c189fc14d9df44cab786e6b833d961cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.675573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c189fc14d9df44cab786e6b833d961cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.680322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a7593e22c5495da5e4dccb342435a3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.684744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a7aa919f-2455-4b75-b087-3acd47ad4614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c189fc14d9df44cab786e6b833d961cf'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.692298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1078/2167] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:19 2022] DELETE /identity/v3/users/c189fc14d9df44cab786e6b833d961cf => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:19.695526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a7593e22c5495da5e4dccb342435a3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.696985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428b842-007f-463b-b905-3699b87efebb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:19.697473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428b842-007f-463b-b905-3699b87efebb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:19.697876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428b842-007f-463b-b905-3699b87efebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:19.721577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9428b842-007f-463b-b905-3699b87efebb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:19.722808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9428b842-007f-463b-b905-3699b87efebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:19.795474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1079/2168] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:19.818299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428b842-007f-463b-b905-3699b87efebb None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:19.818299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9428b842-007f-463b-b905-3699b87efebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:19.852168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-cf090894-fd2e-4b48-80b6-4757ac24ca6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a7593e22c5495da5e4dccb342435a3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:19.853636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1090/2169] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:19 2022] DELETE /identity/v3/users/11a7593e22c5495da5e4dccb342435a3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:19.857834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45222241-920a-4295-b8c0-7ab869aec445 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:19.858163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45222241-920a-4295-b8c0-7ab869aec445 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:19.858381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45222241-920a-4295-b8c0-7ab869aec445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:19.878724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428b842-007f-463b-b905-3699b87efebb None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:19.882852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-45222241-920a-4295-b8c0-7ab869aec445 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:19.884106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-45222241-920a-4295-b8c0-7ab869aec445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:19.976591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1091/2170] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:19.982511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:19.984997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:19.985296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:19.985578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:19.999419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:20.001487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:20.007120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45222241-920a-4295-b8c0-7ab869aec445 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:20.019518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1080/2171] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:20.022924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45222241-920a-4295-b8c0-7ab869aec445 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:20.032855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:20.032855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:20.032855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:20.032855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:20.053431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:20.054939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:20.067235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1092/2172] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:20.773732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:20.775447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:20.790773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db3b43-7bbf-42e7-afb2-5f84c928b619 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:20.798019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:20.804504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:20.804504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:20.804504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] PATH_INFO: `/v3/projects/9f481e9bbc2b480a8d5ae2ea9f50a2c2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:20.807312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f481e9bbc2b480a8d5ae2ea9f50a2c2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:20.812348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:20.850270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:20.851799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:20.867017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796d91-5059-4837-b126-852d324f2c53 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:20.877809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:20.878480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:20.878823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:20.879179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] PATH_INFO: `/v3/projects/959e3f7abc1d4a52bc2a2c1ebcc5037e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:20.880432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] RBAC: Authorizing `identity:delete_project(project_id=959e3f7abc1d4a52bc2a2c1ebcc5037e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:20.882488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:21.008557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f481e9bbc2b480a8d5ae2ea9f50a2c2', 'request_id': 'req-33134cab-92a2-4289-a594-07c7cea89470'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.098056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959e3f7abc1d4a52bc2a2c1ebcc5037e', 'request_id': 'req-e78a5470-feee-4567-b6c6-4c4c0685991d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.127031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f481e9bbc2b480a8d5ae2ea9f50a2c2', 'request_id': 'req-33134cab-92a2-4289-a594-07c7cea89470'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.134893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f481e9bbc2b480a8d5ae2ea9f50a2c2', 'request_id': 'req-33134cab-92a2-4289-a594-07c7cea89470'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.149530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] The token cache is being invalidate because project 9f481e9bbc2b480a8d5ae2ea9f50a2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:21.149822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.150499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.153041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1081/2173] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:20 2022] DELETE /identity/v3/projects/9f481e9bbc2b480a8d5ae2ea9f50a2c2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:21.155978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:21.158657 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:21.238907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134cab-92a2-4289-a594-07c7cea89470 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:21.291186 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959e3f7abc1d4a52bc2a2c1ebcc5037e', 'request_id': 'req-e78a5470-feee-4567-b6c6-4c4c0685991d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.299076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959e3f7abc1d4a52bc2a2c1ebcc5037e', 'request_id': 'req-e78a5470-feee-4567-b6c6-4c4c0685991d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.315108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] The token cache is being invalidate because project 959e3f7abc1d4a52bc2a2c1ebcc5037e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:21.315812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.317633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.320010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1093/2174] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:20 2022] DELETE /identity/v3/projects/959e3f7abc1d4a52bc2a2c1ebcc5037e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:21.324928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:21.327741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:21.329628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:21.330339 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:21.330619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:21.330893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] PATH_INFO: `/v3/users/3002171301ae44588b0ec1ffc2805dda` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:21.332120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=3002171301ae44588b0ec1ffc2805dda)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:21.334113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:21.343174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a5470-feee-4567-b6c6-4c4c0685991d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:21.349712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:21.350407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:21.350775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:21.351061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] PATH_INFO: `/v3/users/1586dadc6f094c019190ee7362d1c3bf` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:21.352248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1586dadc6f094c019190ee7362d1c3bf)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:21.354501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:21.566792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:21.626589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3002171301ae44588b0ec1ffc2805dda'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.632039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1586dadc6f094c019190ee7362d1c3bf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.635025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1586dadc6f094c019190ee7362d1c3bf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.647205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1586dadc6f094c019190ee7362d1c3bf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.661064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1586dadc6f094c019190ee7362d1c3bf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.818897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:21.819607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3002171301ae44588b0ec1ffc2805dda'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.859579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3002171301ae44588b0ec1ffc2805dda'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.863176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3002171301ae44588b0ec1ffc2805dda'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.876363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3002171301ae44588b0ec1ffc2805dda'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.885277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1082/2175] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:21 2022] DELETE /identity/v3/users/3002171301ae44588b0ec1ffc2805dda => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:21.932863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1586dadc6f094c019190ee7362d1c3bf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:21.942649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1094/2176] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:21 2022] DELETE /identity/v3/users/1586dadc6f094c019190ee7362d1c3bf => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:22.882374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:22.885010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:22.887575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:22.889241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:23.006084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554ec90-6124-469f-bbef-141246d4e276 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:23.026316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:23.028298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.028744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.029385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] PATH_INFO: `/v3/projects/3b84216769a4470896b29cbfca0d3dbf` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.031561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b84216769a4470896b29cbfca0d3dbf)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:23.035967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:23.088514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab674539-5b42-4383-93ab-769d559d4dda admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:23.092231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:23.092893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.093171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.093431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] PATH_INFO: `/v3/projects/978f62194f1c4ccd8e54758aab666a84` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.095492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978f62194f1c4ccd8e54758aab666a84)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:23.100496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:23.284478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b84216769a4470896b29cbfca0d3dbf', 'request_id': 'req-9107854e-1205-4d31-807b-65ea23c40a7d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.318767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978f62194f1c4ccd8e54758aab666a84', 'request_id': 'req-483d76a0-8324-49b1-8661-8f7a1cc71816'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.378227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b84216769a4470896b29cbfca0d3dbf', 'request_id': 'req-9107854e-1205-4d31-807b-65ea23c40a7d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.386524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b84216769a4470896b29cbfca0d3dbf', 'request_id': 'req-9107854e-1205-4d31-807b-65ea23c40a7d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.402127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] The token cache is being invalidate because project 3b84216769a4470896b29cbfca0d3dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:23.402671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.403385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9107854e-1205-4d31-807b-65ea23c40a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.410282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1095/2177] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:22 2022] DELETE /identity/v3/projects/3b84216769a4470896b29cbfca0d3dbf => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:23.410282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800cf8-77fd-44ec-8f6f-71802b2f1566 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.410282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800cf8-77fd-44ec-8f6f-71802b2f1566 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.410282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800cf8-77fd-44ec-8f6f-71802b2f1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.428011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4e800cf8-77fd-44ec-8f6f-71802b2f1566 None None] MFA Rules not processed for user `6666a5d0fee44372801adb6effbf0b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:23.429234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4e800cf8-77fd-44ec-8f6f-71802b2f1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:23.476080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978f62194f1c4ccd8e54758aab666a84', 'request_id': 'req-483d76a0-8324-49b1-8661-8f7a1cc71816'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.482931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978f62194f1c4ccd8e54758aab666a84', 'request_id': 'req-483d76a0-8324-49b1-8661-8f7a1cc71816'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.496856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] The token cache is being invalidate because project 978f62194f1c4ccd8e54758aab666a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:23.497148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.497791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:23.499053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1096/2178] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:23.499506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1083/2179] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:22 2022] DELETE /identity/v3/projects/978f62194f1c4ccd8e54758aab666a84 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:23.500826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354b40-7955-4c57-acd6-bcfe5b5e7885 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.501156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354b40-7955-4c57-acd6-bcfe5b5e7885 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.501431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354b40-7955-4c57-acd6-bcfe5b5e7885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.517046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:23.518719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:23.525030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d3354b40-7955-4c57-acd6-bcfe5b5e7885 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:23.526361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d3354b40-7955-4c57-acd6-bcfe5b5e7885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:23.623546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1097/2180] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:23.633882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d3299-401d-4b46-b4a9-3e97b650650d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.634183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d3299-401d-4b46-b4a9-3e97b650650d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.634443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d3299-401d-4b46-b4a9-3e97b650650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.637240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d76a0-8324-49b1-8661-8f7a1cc71816 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:23.664529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-328d3299-401d-4b46-b4a9-3e97b650650d None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:23.665241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:23.669387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.669387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.669591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-328d3299-401d-4b46-b4a9-3e97b650650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:23.669682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] PATH_INFO: `/v3/users/b899dd087233477caadf62d650bbfdb0` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.669929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b899dd087233477caadf62d650bbfdb0)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:23.674089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:23.680826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1098/2181] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:23.684539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d3299-401d-4b46-b4a9-3e97b650650d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:23.698881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d3299-401d-4b46-b4a9-3e97b650650d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:23.706442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:23.707985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.708614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.709010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.711412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:23.711567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:23.713843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:23.732481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1099/2182] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:36:23.733572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:23.749884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657b3ed-fd1e-4d82-8b2c-b10b9218c751 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:23.755468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:23.756210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.756560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.756920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.757637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:23.759718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:23.897687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1100/2183] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:23 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:23.901542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:23.968837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431f791-f8c6-4605-be2e-c8597512867e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:23.974580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:23.975188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:23.975585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:23.975859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:23.976507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:23.980361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:23.996786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b899dd087233477caadf62d650bbfdb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:24.093065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1101/2184] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:23 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:24.106613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:24.129587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63b3b9-013f-4a23-8eb1-5c75279d7629 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:24.133562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b899dd087233477caadf62d650bbfdb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:24.143808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:24.143808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:24.143808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:24.143808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:24.144230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:24.144230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:24.151481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b899dd087233477caadf62d650bbfdb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:24.153038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b899dd087233477caadf62d650bbfdb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:24.162792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b899dd087233477caadf62d650bbfdb0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:24.166005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1102/2185] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:24.169598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:24.170586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1084/2186] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:23 2022] DELETE /identity/v3/users/b899dd087233477caadf62d650bbfdb0 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:24.171805 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:24.188945 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d58f-6a34-4195-aebd-85682bc86f43 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:24.253989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8f340-c6fb-46ef-9c0b-5fdf0141f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:24.254727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f340-c6fb-46ef-9c0b-5fdf0141f309 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:24.255019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f340-c6fb-46ef-9c0b-5fdf0141f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:24.255302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f340-c6fb-46ef-9c0b-5fdf0141f309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:24.256142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8f340-c6fb-46ef-9c0b-5fdf0141f309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:24.257912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8f340-c6fb-46ef-9c0b-5fdf0141f309 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:24.274111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1103/2187] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:24.278325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:24.294995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8807e-7a9e-48b4-bf62-0b7ec29fdcb1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:24.303374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:24.304085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:24.304436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:24.304789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] PATH_INFO: `/v3/projects/e100174117024c75a159e9049aad1af5/users/d12f94e81c2147ee8126caefc409023a/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:24.324798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e100174117024c75a159e9049aad1af5, user_id=d12f94e81c2147ee8126caefc409023a, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:24.327563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:24.441336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1085/2188] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:24 2022] PUT /identity/v3/projects/e100174117024c75a159e9049aad1af5/users/d12f94e81c2147ee8126caefc409023a/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:24.452030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb99e2d-8daa-4e81-992e-a475c1430c44 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:24.452313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb99e2d-8daa-4e81-992e-a475c1430c44 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:24.452585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb99e2d-8daa-4e81-992e-a475c1430c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:24.483840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cdb99e2d-8daa-4e81-992e-a475c1430c44 None None] MFA Rules not processed for user `d12f94e81c2147ee8126caefc409023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:24.485110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cdb99e2d-8daa-4e81-992e-a475c1430c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:24.575721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1104/2189] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:24.588261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:24.595251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:24.690635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2cb8dc-4f97-403b-bd06-37a903843638 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:24.699704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:24.700575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:24.700936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:24.701466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:24.716155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:24.717754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:24.729428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1086/2190] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:24.759855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb99e2d-8daa-4e81-992e-a475c1430c44 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:24.855785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:24.857836 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:24.900791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a303168-76fb-4196-9d60-7f9c1c1bf5c2 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:24.916607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb99e2d-8daa-4e81-992e-a475c1430c44 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:24.921606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:24.922337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:24.922613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:24.922896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] PATH_INFO: `/v3/projects/e14bda9c01374951b99ec43c7e57834e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:24.927071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14bda9c01374951b99ec43c7e57834e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:24.929059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:24.942899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:24.947624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:24.950063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:24.950593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] PATH_INFO: `/v3/users/d12f94e81c2147ee8126caefc409023a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:24.956607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12f94e81c2147ee8126caefc409023a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:24.974049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:25.182543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14bda9c01374951b99ec43c7e57834e', 'request_id': 'req-37062de3-3493-4294-a190-03ac27214183'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.283719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12f94e81c2147ee8126caefc409023a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.284326 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12f94e81c2147ee8126caefc409023a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.291236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12f94e81c2147ee8126caefc409023a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.304968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12f94e81c2147ee8126caefc409023a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.338005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14bda9c01374951b99ec43c7e57834e', 'request_id': 'req-37062de3-3493-4294-a190-03ac27214183'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.348946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14bda9c01374951b99ec43c7e57834e', 'request_id': 'req-37062de3-3493-4294-a190-03ac27214183'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.356669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] The token cache is being invalidate because project e14bda9c01374951b99ec43c7e57834e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:25.356963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.357638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-37062de3-3493-4294-a190-03ac27214183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.359235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1087/2191] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:24 2022] DELETE /identity/v3/projects/e14bda9c01374951b99ec43c7e57834e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:25.364659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253bd3f-9cff-4a8c-8d1e-3e2900182950 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:25.365484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253bd3f-9cff-4a8c-8d1e-3e2900182950 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:25.365757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253bd3f-9cff-4a8c-8d1e-3e2900182950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:25.387389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0253bd3f-9cff-4a8c-8d1e-3e2900182950 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:25.389700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0253bd3f-9cff-4a8c-8d1e-3e2900182950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:25.446927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b528d16b-ceb7-459f-9f03-2bd6dcc2f398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12f94e81c2147ee8126caefc409023a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:25.454596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1105/2192] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:24 2022] DELETE /identity/v3/users/d12f94e81c2147ee8126caefc409023a => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:25.458943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:25.459226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:25.459550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:25.468593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1088/2193] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:25.480654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bd045-46de-4616-84ef-f4db8536bb7c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:25.481319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bd045-46de-4616-84ef-f4db8536bb7c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:25.481785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bd045-46de-4616-84ef-f4db8536bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:25.483082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:25.484370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:25.509190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-825bd045-46de-4616-84ef-f4db8536bb7c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:25.511385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-825bd045-46de-4616-84ef-f4db8536bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:25.591988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1106/2194] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:25.599323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:25.600241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1089/2195] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:25.600753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:25.604449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bd045-46de-4616-84ef-f4db8536bb7c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:25.615392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bd045-46de-4616-84ef-f4db8536bb7c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:25.623046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:25.623699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:25.623977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:25.624301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:25.624966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:25.625329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:25.628043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:25.644581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1090/2196] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:36:25.649474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:25.661017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec246555-ecdc-4da2-aceb-66dacb63be71 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:25.666275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:25.666891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:25.667167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:25.668910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:25.668910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:25.673753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5023c8-e8a6-4538-a414-4953f048ee52 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:25.673849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:25.674382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:25.674999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:25.675330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:25.675690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:25.686534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:25.688256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:25.700523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1107/2197] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:25.860557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1091/2198] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:25 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:25.862587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:25.872687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963a49-6a66-424d-8987-4184bf6d1798 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:25.933347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:25.933987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:25.934224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:25.934496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:25.935132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:25.937176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.074961 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1108/2199] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:25 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:26.080092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.098346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d6d72-5fbb-43d0-a4bd-dd56a4723c2f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.104381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.105742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.106202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.106647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.107496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.109382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.121714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1092/2200] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:26.128745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.139461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dbd2-6296-498a-aa48-45be03270aed admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.145091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e493b20-5d07-4dbb-a276-df4fd04814d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.145704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493b20-5d07-4dbb-a276-df4fd04814d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.146007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493b20-5d07-4dbb-a276-df4fd04814d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.146293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e493b20-5d07-4dbb-a276-df4fd04814d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.149305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e493b20-5d07-4dbb-a276-df4fd04814d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.149305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e493b20-5d07-4dbb-a276-df4fd04814d5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.162007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1109/2201] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:26.166743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.181887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3416d5-8a78-4ae5-ad32-6704f75435d6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.190359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.191719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.192863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.193154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] PATH_INFO: `/v3/projects/461cab61d1fa469aba288f35962c6b89/users/2a62c8c039c140c8ac27cea4e3c12009/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.222473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461cab61d1fa469aba288f35962c6b89, user_id=2a62c8c039c140c8ac27cea4e3c12009, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.226092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.315957 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:26.362664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1093/2202] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:26 2022] PUT /identity/v3/projects/461cab61d1fa469aba288f35962c6b89/users/2a62c8c039c140c8ac27cea4e3c12009/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:26.367641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.367876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.368151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.391595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.393411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:26.400649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] MFA Rules not processed for user `2a62c8c039c140c8ac27cea4e3c12009`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:26.401862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:26.468033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60817e3c-ce89-431d-acac-13f039308d42 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.477287 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1110/2203] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:26.477716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.477716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.477716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.477716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] PATH_INFO: `/v3/projects/e100174117024c75a159e9049aad1af5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.480170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e100174117024c75a159e9049aad1af5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.482208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.486870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.489086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:26.526688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:26.556665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f1b4-fccd-4a78-8f6d-42f2fc9b220e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.560492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.561171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.561398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.561669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.571853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.573245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.583847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1111/2204] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:26.609369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e100174117024c75a159e9049aad1af5', 'request_id': 'req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:26.652628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.654401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:26.672844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b1dfa-94de-4907-8220-eb33aad3f7f8 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.720376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e100174117024c75a159e9049aad1af5', 'request_id': 'req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:26.728119 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e100174117024c75a159e9049aad1af5', 'request_id': 'req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:26.741207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] The token cache is being invalidate because project e100174117024c75a159e9049aad1af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:26.741608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:26.742365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-65ca6f0c-1657-4c24-9a8f-d1841d753c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:26.744949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1094/2205] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:26 2022] DELETE /identity/v3/projects/e100174117024c75a159e9049aad1af5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:26.749685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4686aa5-3953-421a-8a32-62535eaca7f8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.749971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4686aa5-3953-421a-8a32-62535eaca7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.750683 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4686aa5-3953-421a-8a32-62535eaca7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.766709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.767485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.768605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.768605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] PATH_INFO: `/v3/users/eef11344533e4e7397e80efa23039797` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.769281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef11344533e4e7397e80efa23039797)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.771369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.774430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f4686aa5-3953-421a-8a32-62535eaca7f8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:26.775747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f4686aa5-3953-421a-8a32-62535eaca7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:26.793677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1095/2206] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:26.795258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2c0d-b744-423a-b1b2-c0856d667e5b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.796365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2c0d-b744-423a-b1b2-c0856d667e5b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.800197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2c0d-b744-423a-b1b2-c0856d667e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.830651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3f5a2c0d-b744-423a-b1b2-c0856d667e5b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:26.832636 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3f5a2c0d-b744-423a-b1b2-c0856d667e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:26.847454 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1096/2207] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:26.850997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2c0d-b744-423a-b1b2-c0856d667e5b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.860743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2c0d-b744-423a-b1b2-c0856d667e5b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.865648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.866262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.866542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.866862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.867487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:26.868285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.869553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:26.882424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1097/2208] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:36:26.887028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:26.898610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13ddb8-0831-4e4c-ad8b-97e052442ced admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:26.904357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:26.904980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:26.905260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:26.905533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:26.906180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:26.909129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:27.094292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1098/2209] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:26 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:27.107448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:27.107605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef11344533e4e7397e80efa23039797'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:27.107605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef11344533e4e7397e80efa23039797'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:27.113890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef11344533e4e7397e80efa23039797'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:27.128144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef11344533e4e7397e80efa23039797'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:27.165559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233754-a839-4acd-b168-f6bad7373011 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:27.170251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:27.170979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.171124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.171495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.172155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:27.174246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:27.223884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0b44abf5-1e99-429d-b2fc-e16e2a1d3d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef11344533e4e7397e80efa23039797'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:27.229923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1112/2210] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:26 2022] DELETE /identity/v3/users/eef11344533e4e7397e80efa23039797 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:27.236859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.237174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.237487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.261480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1099/2211] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:27 2022] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:27.265517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:27.265669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:27.267858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:27.270959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:27.281806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036689ac-c4da-4755-ac16-346b949e39be admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:27.345248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1113/2212] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:27.357505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:27.360189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:27.365526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:27.366384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.366507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.366951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.367655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:27.369311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:27.392833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1100/2213] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:27.403419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:27.425277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02c548-1ab5-42fd-b407-f104c89fd52c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:27.430229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4334-95ca-4e0c-af07-351fde1b9148 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:27.433616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:27.434248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.434596 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.434814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.435294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d391-501e-4bf3-9aa3-3de59d57fbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:27.435503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:27.436090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d391-501e-4bf3-9aa3-3de59d57fbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.436430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d391-501e-4bf3-9aa3-3de59d57fbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.436781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d391-501e-4bf3-9aa3-3de59d57fbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.437105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:27.448671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d391-501e-4bf3-9aa3-3de59d57fbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:27.450205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d391-501e-4bf3-9aa3-3de59d57fbb6 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:27.461340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1101/2214] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:27.462875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1114/2215] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:27.464598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:27.475369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dfecf-00df-438c-8d5f-28ea8fb86f49 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:27.480813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:27.481480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.481756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.482090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] PATH_INFO: `/v3/projects/8b3d7c473b3c4ec0b4d08ddf337ac236/users/e7d9572c30dd48138dd9a5c46160d9be/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.500190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3d7c473b3c4ec0b4d08ddf337ac236, user_id=e7d9572c30dd48138dd9a5c46160d9be, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:27.503719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:27.585648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1102/2216] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:27 2022] PUT /identity/v3/projects/8b3d7c473b3c4ec0b4d08ddf337ac236/users/e7d9572c30dd48138dd9a5c46160d9be/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:27.601002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.601289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.601559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.646211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] MFA Rules not processed for user `e7d9572c30dd48138dd9a5c46160d9be`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:27.647705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:27.719475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1115/2217] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:27.731071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:27.732770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:27.798355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320d69-4de4-44f6-bd47-8dc9f79afddc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:27.802613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:27.803201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:27.804294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:27.804294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:27.813253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:27.815169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:27.825619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1103/2218] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:36:28.089656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:28.091941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:28.176726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e9958-7873-40d9-8878-f893dc6950bd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:28.181709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:28.182435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:28.182726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:28.183030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] PATH_INFO: `/v3/projects/d76fdfdff0cf4374b87f2db26c942ac5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:28.184240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76fdfdff0cf4374b87f2db26c942ac5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:28.186161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:28.362037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76fdfdff0cf4374b87f2db26c942ac5', 'request_id': 'req-debb915d-e98c-4f4d-be2b-6d33c26d6e94'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.434359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76fdfdff0cf4374b87f2db26c942ac5', 'request_id': 'req-debb915d-e98c-4f4d-be2b-6d33c26d6e94'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.440576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76fdfdff0cf4374b87f2db26c942ac5', 'request_id': 'req-debb915d-e98c-4f4d-be2b-6d33c26d6e94'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.451775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] The token cache is being invalidate because project d76fdfdff0cf4374b87f2db26c942ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:28.452064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.452713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.454721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1116/2219] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:28 2022] DELETE /identity/v3/projects/d76fdfdff0cf4374b87f2db26c942ac5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:28.458877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:28.474739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f832-8c99-46bb-b9c5-e5b30629eb40 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:28.532746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:28.533043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:28.533320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:28.533591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] PATH_INFO: `/v3/users/804b90e41a4f489cb50253acf6f99f67` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:28.534719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=804b90e41a4f489cb50253acf6f99f67)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:28.536673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:28.663692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:28.742301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804b90e41a4f489cb50253acf6f99f67'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.943638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804b90e41a4f489cb50253acf6f99f67'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.964154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804b90e41a4f489cb50253acf6f99f67'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.965475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804b90e41a4f489cb50253acf6f99f67'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.974358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-18b9f979-473c-4015-bbd2-44102200cc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804b90e41a4f489cb50253acf6f99f67'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:28.991670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1104/2220] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:28 2022] DELETE /identity/v3/users/804b90e41a4f489cb50253acf6f99f67 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:29.544200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:29.546383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:29.575730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb915d-e98c-4f4d-be2b-6d33c26d6e94 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:29.664863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:29.669124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:29.669124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:29.669124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] PATH_INFO: `/v3/projects/e3bcb0b8dbdd41868cb9cab1d26cc9c3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:29.669124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bcb0b8dbdd41868cb9cab1d26cc9c3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:29.669609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:29.826060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:29.850770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bcb0b8dbdd41868cb9cab1d26cc9c3', 'request_id': 'req-5be83fb9-5b1e-465e-b710-a0e213214593'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:30.004122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bcb0b8dbdd41868cb9cab1d26cc9c3', 'request_id': 'req-5be83fb9-5b1e-465e-b710-a0e213214593'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:30.013495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bcb0b8dbdd41868cb9cab1d26cc9c3', 'request_id': 'req-5be83fb9-5b1e-465e-b710-a0e213214593'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:30.029554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] The token cache is being invalidate because project e3bcb0b8dbdd41868cb9cab1d26cc9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:30.029858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:30.030536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5be83fb9-5b1e-465e-b710-a0e213214593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:30.032547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1117/2221] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:29 2022] DELETE /identity/v3/projects/e3bcb0b8dbdd41868cb9cab1d26cc9c3 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:30.039507 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2fa95-582e-47cb-a761-cd870d170286 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.040206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2fa95-582e-47cb-a761-cd870d170286 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.040634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2fa95-582e-47cb-a761-cd870d170286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.062513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-99e2fa95-582e-47cb-a761-cd870d170286 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:30.064708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-99e2fa95-582e-47cb-a761-cd870d170286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:30.146654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1105/2222] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:30.154781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb69e-e2f3-422b-9b8b-119808c67355 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.155217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb69e-e2f3-422b-9b8b-119808c67355 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.155813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb69e-e2f3-422b-9b8b-119808c67355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.177875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-198bb69e-e2f3-422b-9b8b-119808c67355 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:30.179110 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-198bb69e-e2f3-422b-9b8b-119808c67355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:30.187494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1118/2223] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:30.193214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2fa95-582e-47cb-a761-cd870d170286 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:30.205316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2fa95-582e-47cb-a761-cd870d170286 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:30.210325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:30.210977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.211254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.211622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.212274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:30.212573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:30.214325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:30.228532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1106/2224] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:36:30.233056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bb69e-e2f3-422b-9b8b-119808c67355 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:30.243535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bb69e-e2f3-422b-9b8b-119808c67355 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:30.248272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:30.248872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.249155 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.249427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.250244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:30.252647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:30.360416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1119/2225] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:30 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:30.361417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:30.371676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37ec82-c967-4057-84cd-0da0e2e12dc7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:30.430456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:30.430987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.431268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.431572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.432222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:30.434187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:30.538552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1107/2226] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:30 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:30.545146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:30.556027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bbccf-a6fb-45f1-be66-f9bb2fe3a092 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:30.561247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:30.561991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.562142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.562418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.563232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:30.564912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:30.575976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1120/2227] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:30.580676 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:30.596829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d4ba9-4f58-4f51-9f39-85a758c89b8c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:30.608353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bd86d-de54-4625-ab58-51a687e988da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:30.609029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd86d-de54-4625-ab58-51a687e988da admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.612495 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd86d-de54-4625-ab58-51a687e988da admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.614947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bd86d-de54-4625-ab58-51a687e988da admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.614947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd86d-de54-4625-ab58-51a687e988da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:30.615650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bd86d-de54-4625-ab58-51a687e988da admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:30.633663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1108/2228] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:30.635043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:30.650181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d3481-d3cb-4a82-aba7-df7007a829ea admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:30.657313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:30.658108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.658392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.658664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] PATH_INFO: `/v3/projects/1b82033269cd403e8f8a7752df59b850/users/6cf6e23c783c4f659764d4a3d8951cda/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.676871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b82033269cd403e8f8a7752df59b850, user_id=6cf6e23c783c4f659764d4a3d8951cda, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:30.679853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:30.709966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:30.775005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1121/2229] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:30 2022] PUT /identity/v3/projects/1b82033269cd403e8f8a7752df59b850/users/6cf6e23c783c4f659764d4a3d8951cda/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:30.785832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2b7a1-8669-47f2-b407-90e2b616cbd7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.786115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2b7a1-8669-47f2-b407-90e2b616cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.786392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2b7a1-8669-47f2-b407-90e2b616cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.817475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f6e2b7a1-8669-47f2-b407-90e2b616cbd7 None None] MFA Rules not processed for user `6cf6e23c783c4f659764d4a3d8951cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:30.818660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f6e2b7a1-8669-47f2-b407-90e2b616cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:30.894283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1109/2230] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:30.899155 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:30.965191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b533-06ec-4d02-a75a-889a47fc93e9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:30.970204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:30.970811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:30.971094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:30.971399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:30.972040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:30.973953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:31.111504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1122/2231] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:30 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:31.117915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2b7a1-8669-47f2-b407-90e2b616cbd7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:31.128684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2b7a1-8669-47f2-b407-90e2b616cbd7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:31.195624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:31.196251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:31.196570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:31.196827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:31.197481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:31.199452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:31.333685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1110/2232] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:31 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:31.338172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:31.349656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420db8d-a68a-4e7e-b49f-0f14233fb064 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:31.354276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:31.354874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:31.355153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:31.355468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:31.361845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:31.361845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:31.368636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1123/2233] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:31.373023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:31.383585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9dcc-d95a-4e2d-a46e-5adcdb185888 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:31.389509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:31.390219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:31.390497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:31.391374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] PATH_INFO: `/v3/projects/769064415e694783ad0ab00be4062d0f/users/b565b78def6247178a2f195ce98d4219/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:31.407924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=769064415e694783ad0ab00be4062d0f, user_id=b565b78def6247178a2f195ce98d4219, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:31.410594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:31.486506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1111/2234] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:31 2022] PUT /identity/v3/projects/769064415e694783ad0ab00be4062d0f/users/b565b78def6247178a2f195ce98d4219/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:31.490668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:31.504737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17fe90-8e31-4543-8df0-7c1f2deca386 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:31.572303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966549ef-f588-415e-b9fb-4fc3c43f555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:31.573060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966549ef-f588-415e-b9fb-4fc3c43f555e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:31.573437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966549ef-f588-415e-b9fb-4fc3c43f555e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:31.573871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966549ef-f588-415e-b9fb-4fc3c43f555e admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:31.574552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966549ef-f588-415e-b9fb-4fc3c43f555e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:31.576571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966549ef-f588-415e-b9fb-4fc3c43f555e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:31.593335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1124/2235] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:31.596476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:31.606964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c01df-5917-434c-9521-8dff89ddb44c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:31.611712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:31.612364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:31.616331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:31.616331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] PATH_INFO: `/v3/projects/769064415e694783ad0ab00be4062d0f/users/b565b78def6247178a2f195ce98d4219/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:31.616331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769064415e694783ad0ab00be4062d0f, user_id=b565b78def6247178a2f195ce98d4219, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:31.617396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:31.630681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1112/2236] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:31 2022] PUT /identity/v3/projects/769064415e694783ad0ab00be4062d0f/users/b565b78def6247178a2f195ce98d4219/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:31.642864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efce92e-932e-4670-887a-a853af612efc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:31.643148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efce92e-932e-4670-887a-a853af612efc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:31.643479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efce92e-932e-4670-887a-a853af612efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:31.671165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2efce92e-932e-4670-887a-a853af612efc None None] MFA Rules not processed for user `b565b78def6247178a2f195ce98d4219`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:31.672540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2efce92e-932e-4670-887a-a853af612efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:31.744880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1125/2237] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:31.756600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:31.758373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:31.834764 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35400-3f70-4f8c-b15b-18b015602415 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:31.838809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db533-d63f-4283-ba7b-e17b832851bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:31.839480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db533-d63f-4283-ba7b-e17b832851bf service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:31.839797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db533-d63f-4283-ba7b-e17b832851bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:31.840078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db533-d63f-4283-ba7b-e17b832851bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:31.850544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db533-d63f-4283-ba7b-e17b832851bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:31.851982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db533-d63f-4283-ba7b-e17b832851bf service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:31.864751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1113/2238] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:32.280418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:32.712863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:33.330599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efce92e-932e-4670-887a-a853af612efc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:33.413687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efce92e-932e-4670-887a-a853af612efc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:33.418304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:33.418970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:33.422355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:33.422355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] PATH_INFO: `/v3/users/6cf6e23c783c4f659764d4a3d8951cda` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:33.422355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf6e23c783c4f659764d4a3d8951cda)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:33.423106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:33.701632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf6e23c783c4f659764d4a3d8951cda'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:33.702432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf6e23c783c4f659764d4a3d8951cda'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:33.710066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf6e23c783c4f659764d4a3d8951cda'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:33.724987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf6e23c783c4f659764d4a3d8951cda'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:33.823235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf6e23c783c4f659764d4a3d8951cda'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:33.829714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1126/2239] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:33 2022] DELETE /identity/v3/users/6cf6e23c783c4f659764d4a3d8951cda => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:33.834337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:33.834795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:33.834883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:33.857735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:33.858988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:33.921992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1114/2240] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:33.931914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:33.933360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:33.992469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:33.997860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1793b14-a5b3-483e-b84d-474af58dfd59 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:34.001850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:34.002460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:34.002739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:34.003009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:34.013011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:34.014531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:34.025601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1127/2241] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:34.098775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:34.539750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:34.541256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:34.558829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151cb04-9d6f-4503-a319-09a085df552b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:34.567826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:34.568542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:34.569043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:34.569489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] PATH_INFO: `/v3/projects/1b82033269cd403e8f8a7752df59b850` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:34.571835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b82033269cd403e8f8a7752df59b850)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:34.574727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:34.695147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b82033269cd403e8f8a7752df59b850', 'request_id': 'req-e62459b4-5f27-48d2-ad5b-68fe89d81558'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:34.800085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b82033269cd403e8f8a7752df59b850', 'request_id': 'req-e62459b4-5f27-48d2-ad5b-68fe89d81558'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:34.807104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b82033269cd403e8f8a7752df59b850', 'request_id': 'req-e62459b4-5f27-48d2-ad5b-68fe89d81558'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:34.819718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] The token cache is being invalidate because project 1b82033269cd403e8f8a7752df59b850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:34.820006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:34.820687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:34.822235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1115/2242] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:34 2022] DELETE /identity/v3/projects/1b82033269cd403e8f8a7752df59b850 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:34.826554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:34.837630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9dd2-d442-4241-bd62-c81bcd88d6fd service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:34.901092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:34.901889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:34.902177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:34.902456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] PATH_INFO: `/v3/users/b565b78def6247178a2f195ce98d4219` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:34.903841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b565b78def6247178a2f195ce98d4219)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:34.908510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:35.120390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b565b78def6247178a2f195ce98d4219'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:35.121062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b565b78def6247178a2f195ce98d4219'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:35.129940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b565b78def6247178a2f195ce98d4219'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:35.148739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b565b78def6247178a2f195ce98d4219'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:35.218053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-35882a91-bdd3-474c-a28d-9b42ea72c429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b565b78def6247178a2f195ce98d4219'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:35.230172 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1128/2243] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:34 2022] DELETE /identity/v3/users/b565b78def6247178a2f195ce98d4219 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:35.487920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:35.893342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:35.894874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:35.916427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62459b4-5f27-48d2-ad5b-68fe89d81558 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:35.992789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:35.993479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:35.993757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:35.998435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] PATH_INFO: `/v3/projects/769064415e694783ad0ab00be4062d0f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.006030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=769064415e694783ad0ab00be4062d0f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:36.008067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:36.123717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:36.178797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769064415e694783ad0ab00be4062d0f', 'request_id': 'req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:36.268208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769064415e694783ad0ab00be4062d0f', 'request_id': 'req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:36.274591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769064415e694783ad0ab00be4062d0f', 'request_id': 'req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:36.286534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] The token cache is being invalidate because project 769064415e694783ad0ab00be4062d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:36.286832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:36.287534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-00ebe363-4b5d-4e3a-ba69-1f30aaa55dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:36.289040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1116/2244] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:35 2022] DELETE /identity/v3/projects/769064415e694783ad0ab00be4062d0f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:36.294050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881160e1-c205-4b7a-9085-4e9f87908f58 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:36.294342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881160e1-c205-4b7a-9085-4e9f87908f58 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:36.294743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881160e1-c205-4b7a-9085-4e9f87908f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.316300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-881160e1-c205-4b7a-9085-4e9f87908f58 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:36.317506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-881160e1-c205-4b7a-9085-4e9f87908f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:36.406545 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1129/2245] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:36.415689 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd62db-9783-417f-b943-90558a6b3a81 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:36.416000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd62db-9783-417f-b943-90558a6b3a81 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:36.416259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd62db-9783-417f-b943-90558a6b3a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.447239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9ccd62db-9783-417f-b943-90558a6b3a81 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:36.448489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9ccd62db-9783-417f-b943-90558a6b3a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:36.459141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1117/2246] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:36.463577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881160e1-c205-4b7a-9085-4e9f87908f58 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:36.485911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881160e1-c205-4b7a-9085-4e9f87908f58 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:36.485911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:36.485911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:36.485911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:36.487146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.487146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:36.487146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:36.487146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:36.501709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1130/2247] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:36:36.506337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd62db-9783-417f-b943-90558a6b3a81 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:36.518396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd62db-9783-417f-b943-90558a6b3a81 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:36.531147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:36.532634 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:36.533034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:36.533352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.534148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:36.537190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:36.653779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1118/2248] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:36 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:36.659502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:36.671191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edcf9f-da7d-4066-8464-851aabc3a3fb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:36.732544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:36.733177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:36.733468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:36.733755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.734542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:36.744183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:36.895112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:36.905246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1131/2249] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:36 2022] POST /identity/v3/users => generated 287 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:36.909598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:36.921257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b4c18-35bc-45fa-9053-a6ae8eb2b7b1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:36.926284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:36.926906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:36.927180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:36.927513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.928161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:36.930070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:36.949740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1119/2250] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:36.951476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:36.962562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390372c-5156-447a-9a4b-23d52a6fbb7b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:36.967527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77896fcf-6c3c-451f-ac34-c6a9947886bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:36.968133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896fcf-6c3c-451f-ac34-c6a9947886bc admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:36.968415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896fcf-6c3c-451f-ac34-c6a9947886bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:36.968732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896fcf-6c3c-451f-ac34-c6a9947886bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:36.969384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77896fcf-6c3c-451f-ac34-c6a9947886bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:36.971251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77896fcf-6c3c-451f-ac34-c6a9947886bc admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:36.982405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1132/2251] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:36.987697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:37.003703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142f85-61a0-4f40-b2cb-1bc987df3ace admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:37.005383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:37.006059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:37.006341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:37.006625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] PATH_INFO: `/v3/projects/fb296eb79e1144788ea8ecdb65ce2c1c/users/0b222ea5a1a343c58baf6d422f5bda35/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:37.024747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb296eb79e1144788ea8ecdb65ce2c1c, user_id=0b222ea5a1a343c58baf6d422f5bda35, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:37.027451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:37.128150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1120/2252] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:36 2022] PUT /identity/v3/projects/fb296eb79e1144788ea8ecdb65ce2c1c/users/0b222ea5a1a343c58baf6d422f5bda35/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:37.134167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d4b6-bc5a-454d-acc1-52ea329cfbf8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:37.134752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d4b6-bc5a-454d-acc1-52ea329cfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:37.134869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3d4b6-bc5a-454d-acc1-52ea329cfbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:37.159697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-35e3d4b6-bc5a-454d-acc1-52ea329cfbf8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:37.161018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-35e3d4b6-bc5a-454d-acc1-52ea329cfbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:37.238382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1133/2253] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:37.249236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:37.251875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:37.323793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53ea90-4a46-4f0f-a288-893ad49dc608 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:37.329761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:37.333517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:37.333517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:37.333517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:37.341197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:37.342661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:37.357477 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1121/2254] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:37.578384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:38.977799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:39.404327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7892-81d9-48f1-94e5-be32ed805885 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:39.404850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7892-81d9-48f1-94e5-be32ed805885 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:39.405308 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7892-81d9-48f1-94e5-be32ed805885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:39.442809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b44b7892-81d9-48f1-94e5-be32ed805885 None None] MFA Rules not processed for user `0b222ea5a1a343c58baf6d422f5bda35`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:39.444398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b44b7892-81d9-48f1-94e5-be32ed805885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:39.520998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1134/2255] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:39.525327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:39.536905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb408e3-8ead-415a-b5f9-da7357a3c0f9 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:39.542358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:39.543095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:39.543423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:39.543746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:39.544486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:39.546758 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:39.711602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1122/2256] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:39 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:36:39.717391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b7892-81d9-48f1-94e5-be32ed805885 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:39.730642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b7892-81d9-48f1-94e5-be32ed805885 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:39.818808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:39.819468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:39.819752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:39.820042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:39.820738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:39.822676 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:39.920431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1135/2257] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:39 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:39.931369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:39.936262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7f517-109d-4f87-9cdc-b37fadc65adf admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:39.941926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:39.942497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:39.942793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:39.943070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:39.943754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:39.945351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:39.956893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1123/2258] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:39.961119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:39.972060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2215ce8-546d-4ed9-b927-60f010240042 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:39.977911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:39.978593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:39.978877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:39.979153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] PATH_INFO: `/v3/projects/1947783354d64efeba10395a4246e215/users/fd196065bf7e426694863a3c0c04adff/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:39.994905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1947783354d64efeba10395a4246e215, user_id=fd196065bf7e426694863a3c0c04adff, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:39.998979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:40.094988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1136/2259] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:39 2022] PUT /identity/v3/projects/1947783354d64efeba10395a4246e215/users/fd196065bf7e426694863a3c0c04adff/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:40.106491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:40.121303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9839-82d4-4825-a9b6-4c35b9f8b71a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:40.186992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:40.187671 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:40.187948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:40.188218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:40.189445 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:40.191285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:40.204144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1124/2260] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:40.208773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:40.220411 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa70eeb-03fc-45b5-bdc2-674d7684dd4d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:40.225393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a26f2-a3f3-4f3f-964e-9c840617a1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:40.231402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a26f2-a3f3-4f3f-964e-9c840617a1d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:40.231402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a26f2-a3f3-4f3f-964e-9c840617a1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:40.231402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a26f2-a3f3-4f3f-964e-9c840617a1d0 admin admin] PATH_INFO: `/v3/projects/1947783354d64efeba10395a4246e215/users/fd196065bf7e426694863a3c0c04adff/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:40.231402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a26f2-a3f3-4f3f-964e-9c840617a1d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1947783354d64efeba10395a4246e215, user_id=fd196065bf7e426694863a3c0c04adff, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:40.232378 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a26f2-a3f3-4f3f-964e-9c840617a1d0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:40.245014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1137/2261] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:40 2022] PUT /identity/v3/projects/1947783354d64efeba10395a4246e215/users/fd196065bf7e426694863a3c0c04adff/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:40.281050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:41.139446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:41.143009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:41.164624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175b6c-0d86-42e4-a2ee-a9fc4daa74bd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:41.254084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:41.254741 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:41.255242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:41.255729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] PATH_INFO: `/v3/users/592cfae4988647f3a3b3aa34ebbda57d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:41.257153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592cfae4988647f3a3b3aa34ebbda57d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:41.259292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:41.538347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592cfae4988647f3a3b3aa34ebbda57d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:41.597985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:41.598523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:41.598523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:41.617327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592cfae4988647f3a3b3aa34ebbda57d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:41.624619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] MFA Rules not processed for user `707fc75182aa430ca16da14982d5733a`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:41.627119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:41.646722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592cfae4988647f3a3b3aa34ebbda57d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:41.647952 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592cfae4988647f3a3b3aa34ebbda57d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:41.663254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a6b205ff-6c54-4d47-86e2-384f4846b1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592cfae4988647f3a3b3aa34ebbda57d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:41.675770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1125/2262] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:41 2022] DELETE /identity/v3/users/592cfae4988647f3a3b3aa34ebbda57d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:41.677524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bfdc-c73e-4e97-a4cb-b6edf35bfc53 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:41.677865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bfdc-c73e-4e97-a4cb-b6edf35bfc53 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:41.678194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bfdc-c73e-4e97-a4cb-b6edf35bfc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:41.706259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b1d9bfdc-c73e-4e97-a4cb-b6edf35bfc53 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:41.706259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b1d9bfdc-c73e-4e97-a4cb-b6edf35bfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:41.722996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1138/2263] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:41.805883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1126/2264] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:41.815052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:41.816424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:41.918577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f97c4e-3592-44d4-9296-89216296184d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:41.964727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:41.965123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:41.965488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:41.981600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eea78-59bd-4c23-8831-8f49d96d101a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:41.982867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eea78-59bd-4c23-8831-8f49d96d101a service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:41.984016 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eea78-59bd-4c23-8831-8f49d96d101a service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:41.984892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eea78-59bd-4c23-8831-8f49d96d101a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:41.996721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eea78-59bd-4c23-8831-8f49d96d101a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:41.998252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eea78-59bd-4c23-8831-8f49d96d101a service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:41.998571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] MFA Rules not processed for user `fd196065bf7e426694863a3c0c04adff`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:42.000162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:42.012888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1139/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:42.062467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:42.138272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1127/2266] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:42.140336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:42.141530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:42.141807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:42.166183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] MFA Rules not processed for user `0b222ea5a1a343c58baf6d422f5bda35`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:42.167211 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:42.232716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1140/2267] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:42.244168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:42.245715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:42.355537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d149c-0d71-4ecc-8022-1989108566c1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:42.361086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef3df1-357a-495a-9c69-7d1875ac4c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:42.361681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3df1-357a-495a-9c69-7d1875ac4c1c service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:42.361880 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3df1-357a-495a-9c69-7d1875ac4c1c service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:42.362158 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3df1-357a-495a-9c69-7d1875ac4c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:42.364019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bbef3df1-357a-495a-9c69-7d1875ac4c1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:42.375442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef3df1-357a-495a-9c69-7d1875ac4c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:42.377063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef3df1-357a-495a-9c69-7d1875ac4c1c service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:42.387454 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1128/2268] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:42.587560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:42.588619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:42.606094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc0175-e63b-4bb3-82f5-c921a52d0582 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:42.613617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:42.614291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:42.614580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:42.614857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] PATH_INFO: `/v3/projects/7552b8d996c04ecd8ad0a49241404a59` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:42.616462 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7552b8d996c04ecd8ad0a49241404a59)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:42.618604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:42.741874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7552b8d996c04ecd8ad0a49241404a59', 'request_id': 'req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:42.851810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7552b8d996c04ecd8ad0a49241404a59', 'request_id': 'req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:42.858510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7552b8d996c04ecd8ad0a49241404a59', 'request_id': 'req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:42.873062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] The token cache is being invalidate because project 7552b8d996c04ecd8ad0a49241404a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:42.879788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:42.879788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:42.879788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1141/2269] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:42 2022] DELETE /identity/v3/projects/7552b8d996c04ecd8ad0a49241404a59 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:42.882605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91a5f-ef28-4d79-931b-a714f65acf59 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:42.882816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91a5f-ef28-4d79-931b-a714f65acf59 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:42.883440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91a5f-ef28-4d79-931b-a714f65acf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:42.911262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3bc91a5f-ef28-4d79-931b-a714f65acf59 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:42.912633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3bc91a5f-ef28-4d79-931b-a714f65acf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:42.952661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:42.955428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:43.004091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1129/2270] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:43.012784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bb71-c54f-4c96-8060-07ce0d51bb19 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.014078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bb71-c54f-4c96-8060-07ce0d51bb19 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.014078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665bb71-c54f-4c96-8060-07ce0d51bb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.035785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9665bb71-c54f-4c96-8060-07ce0d51bb19 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:43.037059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9665bb71-c54f-4c96-8060-07ce0d51bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:43.045669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1130/2271] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:43.046125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b9cf7-ffb5-474f-9781-8fd7cb4c66f2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.051309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665bb71-c54f-4c96-8060-07ce0d51bb19 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.052268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.052928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.053213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.053484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] PATH_INFO: `/v3/users/2a62c8c039c140c8ac27cea4e3c12009` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.054683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a62c8c039c140c8ac27cea4e3c12009)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.056680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.061276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665bb71-c54f-4c96-8060-07ce0d51bb19 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.069392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.070035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.070418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.070562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.071233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:36:43.071581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.073416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.088527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1131/2272] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:36:43.094232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.105217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077f3ee-8c2f-4b30-aee7-f398c3fb6b0f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.110855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.111782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.112070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.112491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.113281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.115592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.194575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:43.305512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1132/2273] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:36:43 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:43.310752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.382635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a62c8c039c140c8ac27cea4e3c12009'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:43.383377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a62c8c039c140c8ac27cea4e3c12009'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:43.387917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d692af-9e18-4fe1-b7ff-1a64c400e007 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.393841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.394470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.394757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.395030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.395647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a62c8c039c140c8ac27cea4e3c12009'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:43.395784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.397746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.411614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a62c8c039c140c8ac27cea4e3c12009'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:43.510222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1133/2274] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:36:43 2022] POST /identity/v3/users => generated 283 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:36:43.514556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.518820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:43.521288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2de48bbb-5026-462b-b8a9-d367d671ff2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a62c8c039c140c8ac27cea4e3c12009'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:43.528453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1142/2275] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:36:42 2022] DELETE /identity/v3/users/2a62c8c039c140c8ac27cea4e3c12009 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:43.530949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c312-845a-4f90-ace3-5bbd5e171017 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.536584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.536584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.536584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.564434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:43.565789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:43.614982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.616070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.616668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.617024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.617839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.620079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.638775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1134/2276] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:36:43.642292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.652962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:43.653527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabc401-9e6c-4d5c-a5c9-a858ffa0a0d4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.656125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1143/2277] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:36:43.663382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.663382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.663382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.663382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.663721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.663721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.677969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1135/2278] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:36:43.681396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.683057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.683281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:43.694421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7cd31e-39c8-4e8b-b6c6-7ec63e272f49 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.700490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.701166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.701441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.701739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] PATH_INFO: `/v3/projects/4169874cc3d445ea9080e03988840387/users/d949ed8dec924b658384fd60107c2be2/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.719170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4169874cc3d445ea9080e03988840387, user_id=d949ed8dec924b658384fd60107c2be2, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.722010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.749359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e0a40-38ef-4ff7-ac61-6895cbbdb111 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:43.756081 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44085574-d4af-4d69-bb31-7436cc0b56ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:43.757141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085574-d4af-4d69-bb31-7436cc0b56ad service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.757670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085574-d4af-4d69-bb31-7436cc0b56ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.758271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085574-d4af-4d69-bb31-7436cc0b56ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.774611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085574-d4af-4d69-bb31-7436cc0b56ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:43.776163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44085574-d4af-4d69-bb31-7436cc0b56ad service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:43.788490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1144/2279] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:43.813786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1136/2280] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:36:43 2022] PUT /identity/v3/projects/4169874cc3d445ea9080e03988840387/users/d949ed8dec924b658384fd60107c2be2/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:36:43.827492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:43.831940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:43.831940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:43.868124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] MFA Rules not processed for user `d949ed8dec924b658384fd60107c2be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:36:43.869547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:43.966990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1145/2281] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:36:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:36:43.982247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:43.985355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:44.123996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9859e-1986-49b7-8997-75770d36ef83 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:44.130734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:44.131113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:44.131589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:44.132030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:44.148013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:44.151858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:44.169729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1137/2282] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:36:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:36:44.170300 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:44.346733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:36:44.348582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:36:44.441481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2353a1-a2a8-4cc1-acb8-a4690a01496a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:36:44.448869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:36:44.450004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:36:44.450445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:36:44.450885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] PATH_INFO: `/v3/projects/461cab61d1fa469aba288f35962c6b89` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:36:44.453083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=461cab61d1fa469aba288f35962c6b89)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:36:44.455201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:36:44.698983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461cab61d1fa469aba288f35962c6b89', 'request_id': 'req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:44.817116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461cab61d1fa469aba288f35962c6b89', 'request_id': 'req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:44.823442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461cab61d1fa469aba288f35962c6b89', 'request_id': 'req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:44.838049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] The token cache is being invalidate because project 461cab61d1fa469aba288f35962c6b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:36:44.838415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:44.839815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:36:44.841515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1146/2283] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:36:44 2022] DELETE /identity/v3/projects/461cab61d1fa469aba288f35962c6b89 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:36:45.440250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:45.554972 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:47.612193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:49.366034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:49.549730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:51.235445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:51.451908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:53.111024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:53.556930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:53.988821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:55.287221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:55.497398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:56.880144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:57.503396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:58.817268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:36:59.496801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:01.524410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:02.394704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:04.393809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:04.668295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:05.479263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:06.170392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:07.287759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:07.646578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:08.736792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:09.125291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:10.975164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:11.382248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:12.307559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:12.399003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:13.338623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:13.595445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:14.554235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:14.557422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:14.570665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1476-460a-41ad-bc87-0f807222e2db service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:14.633746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102aae9-f0cd-4f11-92f8-e5464ba2104c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:14.634780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102aae9-f0cd-4f11-92f8-e5464ba2104c service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:14.635261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102aae9-f0cd-4f11-92f8-e5464ba2104c service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:14.636054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102aae9-f0cd-4f11-92f8-e5464ba2104c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:14.639184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b102aae9-f0cd-4f11-92f8-e5464ba2104c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:14.737046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102aae9-f0cd-4f11-92f8-e5464ba2104c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:14.738515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102aae9-f0cd-4f11-92f8-e5464ba2104c service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:14.751703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1138/2284] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:14.830590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:16.216251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:16.816629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:17.268075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:18.602806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:18.604386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:18.678465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2c0da-2dbe-431a-b21c-636f8b00fe4c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:18.683860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:18.684502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:18.684785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:18.685091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] PATH_INFO: `/v3/users/e7d9572c30dd48138dd9a5c46160d9be` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:18.688688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d9572c30dd48138dd9a5c46160d9be)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:18.688688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:18.913319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:18.966202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d9572c30dd48138dd9a5c46160d9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:18.967148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d9572c30dd48138dd9a5c46160d9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:18.975522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d9572c30dd48138dd9a5c46160d9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:18.990023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d9572c30dd48138dd9a5c46160d9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:19.084094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d9572c30dd48138dd9a5c46160d9be'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:19.099980 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1147/2285] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:37:18 2022] DELETE /identity/v3/users/e7d9572c30dd48138dd9a5c46160d9be => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:19.104534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:19.105118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:19.105491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:19.125802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:19.127876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:19.131856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:19.196938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1139/2286] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:19.206823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:19.208418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:19.274850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87652d87-72d6-4d7e-bfd0-429f59217f8d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:19.278826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75218f-2b29-447d-ad75-b90f6827f242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:19.279485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75218f-2b29-447d-ad75-b90f6827f242 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:19.279824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75218f-2b29-447d-ad75-b90f6827f242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:19.280103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75218f-2b29-447d-ad75-b90f6827f242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:19.290293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75218f-2b29-447d-ad75-b90f6827f242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:19.291785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75218f-2b29-447d-ad75-b90f6827f242 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:19.307417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1148/2287] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:19.993597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:20.083035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:20.088842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:20.111489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10fe83-5e6d-4fa0-b444-2102f8844b5a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:20.123469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:20.125506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:20.126213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:20.126668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] PATH_INFO: `/v3/projects/8b3d7c473b3c4ec0b4d08ddf337ac236` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:20.128857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3d7c473b3c4ec0b4d08ddf337ac236)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:20.132410 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:20.279740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:20.308036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3d7c473b3c4ec0b4d08ddf337ac236', 'request_id': 'req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:20.406116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3d7c473b3c4ec0b4d08ddf337ac236', 'request_id': 'req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:20.413508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3d7c473b3c4ec0b4d08ddf337ac236', 'request_id': 'req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:20.453371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] The token cache is being invalidate because project 8b3d7c473b3c4ec0b4d08ddf337ac236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:37:20.453371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:20.454185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f0f4ece7-ed10-4da6-8d28-6a0c5dc554b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:20.459282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1140/2288] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:37:20 2022] DELETE /identity/v3/projects/8b3d7c473b3c4ec0b4d08ddf337ac236 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:20.461237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795bcf-dbb6-4778-9b92-ef3c7c0cc5b0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:20.462903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795bcf-dbb6-4778-9b92-ef3c7c0cc5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:20.463241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795bcf-dbb6-4778-9b92-ef3c7c0cc5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:20.516788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-56795bcf-dbb6-4778-9b92-ef3c7c0cc5b0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:20.519309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-56795bcf-dbb6-4778-9b92-ef3c7c0cc5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:20.611631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1149/2289] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:20.620524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978264a-cdde-41ce-9cd5-03a2ec42df97 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:20.621263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978264a-cdde-41ce-9cd5-03a2ec42df97 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:20.621712 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978264a-cdde-41ce-9cd5-03a2ec42df97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:20.645039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8978264a-cdde-41ce-9cd5-03a2ec42df97 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:20.646286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8978264a-cdde-41ce-9cd5-03a2ec42df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:20.664051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1141/2290] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:20.666073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795bcf-dbb6-4778-9b92-ef3c7c0cc5b0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:20.684009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795bcf-dbb6-4778-9b92-ef3c7c0cc5b0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:20.684584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:20.685412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:20.685937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:20.686828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:20.687987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:37:20.688526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:20.691916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:20.709547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1150/2291] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:37:20.713816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978264a-cdde-41ce-9cd5-03a2ec42df97 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:20.729544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978264a-cdde-41ce-9cd5-03a2ec42df97 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:20.731141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:20.731832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:20.732115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:20.732413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:20.733424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:20.735575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:20.824285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1142/2292] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:20 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:20.830319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:20.844213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ed85a-8cd0-4981-b230-ebfc18461b48 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:20.915127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:20.915748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:20.916026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:20.916296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:20.917120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:20.919035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:20.924679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:21.016834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1151/2293] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:20 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:37:21.021036 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:21.032157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a667b-790b-4d8f-aec8-39e326322a59 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:21.037329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:21.038124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:21.038401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:21.039959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:21.039959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:21.041968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:21.054018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1143/2294] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:21.058028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:21.069316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bf156-b274-42b3-bc39-24d4874c9a01 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:21.074223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaee16f-ec1b-429c-99c3-383a66a4c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:21.074836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaee16f-ec1b-429c-99c3-383a66a4c216 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:21.075117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaee16f-ec1b-429c-99c3-383a66a4c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:21.075427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaee16f-ec1b-429c-99c3-383a66a4c216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:21.076083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaee16f-ec1b-429c-99c3-383a66a4c216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:21.077752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaee16f-ec1b-429c-99c3-383a66a4c216 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:21.089161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1152/2295] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:21.094272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:21.105012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a308-61da-4012-8722-03ceeb61ce1e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:21.110892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:21.111586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:21.112143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:21.112143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] PATH_INFO: `/v3/projects/b7d67ac12cdd4aaaaef36194f38c8b5b/users/e7033acf7be34e3a8be98f7c29bdf028/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:21.130937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d67ac12cdd4aaaaef36194f38c8b5b, user_id=e7033acf7be34e3a8be98f7c29bdf028, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:21.133857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:21.263466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1144/2296] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:21 2022] PUT /identity/v3/projects/b7d67ac12cdd4aaaaef36194f38c8b5b/users/e7033acf7be34e3a8be98f7c29bdf028/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:21.274992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:21.275322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:21.275660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:21.307003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] MFA Rules not processed for user `e7033acf7be34e3a8be98f7c29bdf028`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:21.308255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:21.382473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1153/2297] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:21.396278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:21.398568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:21.457443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273c5b7-573b-4689-89be-f97ee746527e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:21.461460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:21.462075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:21.462402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:21.462668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:21.472151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:21.473583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:21.482473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1145/2298] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:21.513162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:21.633319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:23.496629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:23.527501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:23.532486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:23.630574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdd348-0889-4a44-ad08-a9a33339a530 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:23.634499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339bded-1be7-4a13-aa3a-2dfb459e033a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:23.635300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bded-1be7-4a13-aa3a-2dfb459e033a service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:23.635869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bded-1be7-4a13-aa3a-2dfb459e033a service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:23.636239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bded-1be7-4a13-aa3a-2dfb459e033a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:23.638401 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9339bded-1be7-4a13-aa3a-2dfb459e033a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:23.714373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339bded-1be7-4a13-aa3a-2dfb459e033a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:23.715953 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339bded-1be7-4a13-aa3a-2dfb459e033a service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:23.727434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1154/2299] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:23.770209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:24.741597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:25.124992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:25.850336 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:26.127198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:26.131625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:26.218515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397a6e-218f-443e-adfd-ca9ffe68705b service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:26.224723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:26.226261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:26.227402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:26.227904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] PATH_INFO: `/v3/users/e7033acf7be34e3a8be98f7c29bdf028` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:26.229310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7033acf7be34e3a8be98f7c29bdf028)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:26.231449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:26.432391 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7033acf7be34e3a8be98f7c29bdf028'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:26.485268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7033acf7be34e3a8be98f7c29bdf028'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:26.515323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7033acf7be34e3a8be98f7c29bdf028'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:26.516156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7033acf7be34e3a8be98f7c29bdf028'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:26.527120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7033acf7be34e3a8be98f7c29bdf028'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:26.537451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1146/2300] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:37:26 2022] DELETE /identity/v3/users/e7033acf7be34e3a8be98f7c29bdf028 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:26.541772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:26.542611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:26.543056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:26.568263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:26.572291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:26.646369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1155/2301] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:26.661957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:26.663588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:26.724456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:26.768892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7fd9b-26fb-4ac4-86d0-75479ab78a48 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:26.775494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94af92-a654-4877-ba51-d0435dd2f676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:26.776138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94af92-a654-4877-ba51-d0435dd2f676 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:26.776998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94af92-a654-4877-ba51-d0435dd2f676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:26.777529 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94af92-a654-4877-ba51-d0435dd2f676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:26.797067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94af92-a654-4877-ba51-d0435dd2f676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:26.804111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94af92-a654-4877-ba51-d0435dd2f676 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:26.835445 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1147/2302] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:27.210012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:27.417096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:27.418742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:27.434252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5398db2-7eed-4b55-b0b1-a3e0846b32b9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:27.443764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:27.443764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:27.443764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:27.443764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] PATH_INFO: `/v3/projects/b7d67ac12cdd4aaaaef36194f38c8b5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:27.444509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d67ac12cdd4aaaaef36194f38c8b5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:27.445195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:27.646675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d67ac12cdd4aaaaef36194f38c8b5b', 'request_id': 'req-e802ad43-16a5-4b83-bdc6-d07485068b6c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:27.747004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d67ac12cdd4aaaaef36194f38c8b5b', 'request_id': 'req-e802ad43-16a5-4b83-bdc6-d07485068b6c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:27.753445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d67ac12cdd4aaaaef36194f38c8b5b', 'request_id': 'req-e802ad43-16a5-4b83-bdc6-d07485068b6c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:27.765646 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] The token cache is being invalidate because project b7d67ac12cdd4aaaaef36194f38c8b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:37:27.766137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:27.766799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-e802ad43-16a5-4b83-bdc6-d07485068b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:27.768410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1156/2303] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:37:27 2022] DELETE /identity/v3/projects/b7d67ac12cdd4aaaaef36194f38c8b5b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:27.773361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5652f-2e64-41ae-b9fe-451318e57add None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:27.773818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5652f-2e64-41ae-b9fe-451318e57add None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:27.773974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5652f-2e64-41ae-b9fe-451318e57add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:27.795859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6ae5652f-2e64-41ae-b9fe-451318e57add None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:27.797405 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6ae5652f-2e64-41ae-b9fe-451318e57add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:27.859520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1148/2304] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:27.867400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36912e8b-78af-4cb8-9adc-62fed1c6387e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:27.867694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36912e8b-78af-4cb8-9adc-62fed1c6387e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:27.867960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36912e8b-78af-4cb8-9adc-62fed1c6387e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:27.889274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-36912e8b-78af-4cb8-9adc-62fed1c6387e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:27.890729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-36912e8b-78af-4cb8-9adc-62fed1c6387e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:27.898788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1157/2305] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:27.903465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5652f-2e64-41ae-b9fe-451318e57add None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:27.913888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5652f-2e64-41ae-b9fe-451318e57add None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:27.918722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:27.919413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:27.919714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:27.920630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:27.921645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:37:27.921956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:27.923659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:27.940280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1149/2306] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:37:27.941814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36912e8b-78af-4cb8-9adc-62fed1c6387e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:27.951257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36912e8b-78af-4cb8-9adc-62fed1c6387e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:27.956500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:27.957193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:27.957471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:27.957740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:27.958389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:27.960333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:28.067597 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1158/2307] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:27 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:28.068970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:28.080340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04890580-3f93-41de-b64d-251a3372846c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:28.140464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:28.140989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:28.141265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:28.141534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:28.142164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:28.144159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:28.221629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:28.278957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1150/2308] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:28 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:28.283229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:28.294461 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d0d65-5e49-42b7-919d-e8eaceb97314 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:28.299732 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:28.300354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:28.300620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:28.300890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:28.301541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:28.303142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:28.314054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1159/2309] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:28.319927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:28.330203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02af7-d69b-4052-827e-f3b36035bb9a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:28.335178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78d14-69f0-4549-863a-9144d79ac001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:28.335826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78d14-69f0-4549-863a-9144d79ac001 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:28.336109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78d14-69f0-4549-863a-9144d79ac001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:28.336393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78d14-69f0-4549-863a-9144d79ac001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:28.337090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c78d14-69f0-4549-863a-9144d79ac001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:28.338665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c78d14-69f0-4549-863a-9144d79ac001 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:28.350246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1151/2310] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:28.366361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:28.377362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f7eec-b795-4a39-b43c-ab3c2b970237 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:28.382157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:28.382968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:28.383449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:28.383901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] PATH_INFO: `/v3/projects/265b6dcf44e742f7bd83f61da3c2791e/users/e007f0a7589c45d0a39f7dc6b514042c/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:28.389231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:28.403031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=265b6dcf44e742f7bd83f61da3c2791e, user_id=e007f0a7589c45d0a39f7dc6b514042c, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:28.406280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:28.525573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1160/2311] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:28 2022] PUT /identity/v3/projects/265b6dcf44e742f7bd83f61da3c2791e/users/e007f0a7589c45d0a39f7dc6b514042c/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:28.539440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:28.539822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:28.540160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:28.576482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] MFA Rules not processed for user `e007f0a7589c45d0a39f7dc6b514042c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:28.577698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:28.645895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1152/2312] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:28.658243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:28.660286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:28.721638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a453d-c34d-41f6-983b-c92bb2a1c4db admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:28.726772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41098c-80b7-40c9-9980-4e82c7f6ec10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:28.727416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41098c-80b7-40c9-9980-4e82c7f6ec10 service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:28.727703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41098c-80b7-40c9-9980-4e82c7f6ec10 service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:28.728013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41098c-80b7-40c9-9980-4e82c7f6ec10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:28.740942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41098c-80b7-40c9-9980-4e82c7f6ec10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:28.742784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41098c-80b7-40c9-9980-4e82c7f6ec10 service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:28.753357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1161/2313] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:28.918785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:29.327925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:30.564619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:30.684440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:31.032705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:31.118685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:31.233156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:31.461468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:31.638674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:31.735917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:31.849695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.038368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.101881 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.250672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.347186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.570018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.649939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.866907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:32.895101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:33.057989 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:33.090282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:33.644962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:34.084215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:34.461276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:34.598530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:34.752674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:34.781276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:34.929780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:34.964940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:35.427294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:35.489658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:36.028215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:36.106892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:40.300121 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:40.301773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:40.388914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f843f-1dc9-43bb-8331-4ae5932458c3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:40.395233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:40.396213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:40.396496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:40.396777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] PATH_INFO: `/v3/users/d949ed8dec924b658384fd60107c2be2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:40.398001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d949ed8dec924b658384fd60107c2be2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:40.400050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:40.710621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd949ed8dec924b658384fd60107c2be2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:40.780770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd949ed8dec924b658384fd60107c2be2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:40.790145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd949ed8dec924b658384fd60107c2be2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:40.791679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd949ed8dec924b658384fd60107c2be2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:40.799980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd949ed8dec924b658384fd60107c2be2'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:40.807242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1153/2314] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:37:40 2022] DELETE /identity/v3/users/d949ed8dec924b658384fd60107c2be2 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:37:40.816136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:40.816691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:40.816691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:40.840668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:40.841781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:40.908096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1162/2315] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:40.918557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:40.920088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:40.940139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:41.110168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d6a96-beea-4542-9e85-9549ce7e8fc1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:41.114247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd65fc4-5071-4978-be34-6b43b50198c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:41.114852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65fc4-5071-4978-be34-6b43b50198c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:41.115155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65fc4-5071-4978-be34-6b43b50198c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:41.115456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65fc4-5071-4978-be34-6b43b50198c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:41.124459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd65fc4-5071-4978-be34-6b43b50198c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:41.127728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd65fc4-5071-4978-be34-6b43b50198c6 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:41.136417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1154/2316] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:41.540268 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:41.542410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:41.562171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a698adb-b26d-4031-98d3-711120a63486 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:41.568267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:41.569070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:41.569434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:41.569737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] PATH_INFO: `/v3/projects/4169874cc3d445ea9080e03988840387` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:41.571215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4169874cc3d445ea9080e03988840387)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:41.573715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:41.732196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:41.735748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4169874cc3d445ea9080e03988840387', 'request_id': 'req-be74fa35-c45e-411d-95e5-13582d5b68f4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:41.797489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4169874cc3d445ea9080e03988840387', 'request_id': 'req-be74fa35-c45e-411d-95e5-13582d5b68f4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:41.803845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4169874cc3d445ea9080e03988840387', 'request_id': 'req-be74fa35-c45e-411d-95e5-13582d5b68f4'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:41.821655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] The token cache is being invalidate because project 4169874cc3d445ea9080e03988840387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:37:41.822309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:41.822669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-be74fa35-c45e-411d-95e5-13582d5b68f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:41.824276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1163/2317] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:37:41 2022] DELETE /identity/v3/projects/4169874cc3d445ea9080e03988840387 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:41.829260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd5803-122e-4e5a-b6ae-46c569551154 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:41.829669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd5803-122e-4e5a-b6ae-46c569551154 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:41.829832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd5803-122e-4e5a-b6ae-46c569551154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:41.856364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d7fd5803-122e-4e5a-b6ae-46c569551154 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:41.856364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d7fd5803-122e-4e5a-b6ae-46c569551154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:41.919805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1155/2318] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:41.928459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73267f-d3c2-4bea-a3a1-a3f7b96d3bf5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:41.928750 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73267f-d3c2-4bea-a3a1-a3f7b96d3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:41.929026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73267f-d3c2-4bea-a3a1-a3f7b96d3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:41.949981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9f73267f-d3c2-4bea-a3a1-a3f7b96d3bf5 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:41.951445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9f73267f-d3c2-4bea-a3a1-a3f7b96d3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:41.960476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1164/2319] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:41.965906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd5803-122e-4e5a-b6ae-46c569551154 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:41.977718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd5803-122e-4e5a-b6ae-46c569551154 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:41.982498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:41.983147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:41.985822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:41.985822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:41.985822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:37:41.985822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:41.986550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:41.998858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1156/2320] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:37:42.003931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73267f-d3c2-4bea-a3a1-a3f7b96d3bf5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:42.014270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73267f-d3c2-4bea-a3a1-a3f7b96d3bf5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:42.023389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:42.023389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.023389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.023389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.023907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:42.023907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:42.120761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1165/2321] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:42 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:42.126080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:42.137514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ea23-3472-4bfb-ade6-aa8965118977 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:42.212419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:42.213015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.213471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.213779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.214479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:42.216672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:42.332264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1157/2322] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:42 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:37:42.336304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:42.346919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca6d50-079c-4458-85ab-cbcb8993f491 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:42.351647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:42.352248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.352527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.352800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.353446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:42.355071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:42.366800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1166/2323] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:42.370978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:42.381666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05500bcd-4792-4237-b815-dfc58badf30f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:42.387075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effcac6-13dd-40af-b4d8-d77f4f5fafa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:42.387799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effcac6-13dd-40af-b4d8-d77f4f5fafa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.388164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effcac6-13dd-40af-b4d8-d77f4f5fafa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.388464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effcac6-13dd-40af-b4d8-d77f4f5fafa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.389142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effcac6-13dd-40af-b4d8-d77f4f5fafa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:42.391169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effcac6-13dd-40af-b4d8-d77f4f5fafa8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:42.403397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1158/2324] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:42.407255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:42.417888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a714ee-53b4-4b2b-bb0e-e06cc6ac899b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:42.424580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:42.425288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.425640 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.425919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] PATH_INFO: `/v3/projects/90ef1c7a5b494a6686b00e03fe4c0848/users/47d6b9629dd34c99b9f62c91529a715b/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.442314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ef1c7a5b494a6686b00e03fe4c0848, user_id=47d6b9629dd34c99b9f62c91529a715b, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:42.446719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:42.535670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1167/2325] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:42 2022] PUT /identity/v3/projects/90ef1c7a5b494a6686b00e03fe4c0848/users/47d6b9629dd34c99b9f62c91529a715b/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:42.547711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17336cb5-3e64-4fcc-b340-eaf3bb50297c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.552989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17336cb5-3e64-4fcc-b340-eaf3bb50297c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.552989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17336cb5-3e64-4fcc-b340-eaf3bb50297c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.579247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-17336cb5-3e64-4fcc-b340-eaf3bb50297c None None] MFA Rules not processed for user `47d6b9629dd34c99b9f62c91529a715b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:42.580567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-17336cb5-3e64-4fcc-b340-eaf3bb50297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:42.594199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:42.667260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1159/2326] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:42.684693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:42.690696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:42.769588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61053689-bd4c-4de6-8560-2dfc7911a653 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:42.774565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b9b97-d371-486b-ace9-8894f92993cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:42.775144 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9b97-d371-486b-ace9-8894f92993cf service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.775457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9b97-d371-486b-ace9-8894f92993cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.775922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b9b97-d371-486b-ace9-8894f92993cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.795856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b9b97-d371-486b-ace9-8894f92993cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:42.797428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b9b97-d371-486b-ace9-8894f92993cf service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:42.812811 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1168/2327] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:42.849128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17336cb5-3e64-4fcc-b340-eaf3bb50297c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:42.944312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17336cb5-3e64-4fcc-b340-eaf3bb50297c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:42.950805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:42.951543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:42.951771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:42.952046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] PATH_INFO: `/v3/users/47d6b9629dd34c99b9f62c91529a715b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:42.953224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d6b9629dd34c99b9f62c91529a715b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:42.955325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:43.139012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d6b9629dd34c99b9f62c91529a715b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:43.226673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d6b9629dd34c99b9f62c91529a715b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:43.244030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d6b9629dd34c99b9f62c91529a715b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:43.244844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d6b9629dd34c99b9f62c91529a715b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:43.252453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d6b9629dd34c99b9f62c91529a715b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:43.259085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1160/2328] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:37:42 2022] DELETE /identity/v3/users/47d6b9629dd34c99b9f62c91529a715b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:43.264264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:43.264824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:43.264960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:43.286433 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:43.287668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:43.357085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1169/2329] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:43.367858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:43.369400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:43.411198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:43.435050 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ee51-257e-4413-b278-2b5396c2896d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:43.438979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b3cc-3355-4198-a3c5-7a38f1f043f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:43.439854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b3cc-3355-4198-a3c5-7a38f1f043f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:43.440140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b3cc-3355-4198-a3c5-7a38f1f043f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:43.440444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b3cc-3355-4198-a3c5-7a38f1f043f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:43.450488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7b3cc-3355-4198-a3c5-7a38f1f043f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:43.451953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7b3cc-3355-4198-a3c5-7a38f1f043f3 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:43.461776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1161/2330] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:37:43.975645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:43.978247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:43.992111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea22086-6aff-47f2-8da8-9c1deb3cd423 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:44.013142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:44.015442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.015442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.015442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] PATH_INFO: `/v3/projects/90ef1c7a5b494a6686b00e03fe4c0848` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.015658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ef1c7a5b494a6686b00e03fe4c0848)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:44.018849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:44.026692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:44.164303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ef1c7a5b494a6686b00e03fe4c0848', 'request_id': 'req-0a833f22-19f6-4855-96ed-757227e01a7a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:44.232488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ef1c7a5b494a6686b00e03fe4c0848', 'request_id': 'req-0a833f22-19f6-4855-96ed-757227e01a7a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:44.239114 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ef1c7a5b494a6686b00e03fe4c0848', 'request_id': 'req-0a833f22-19f6-4855-96ed-757227e01a7a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:44.253959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] The token cache is being invalidate because project 90ef1c7a5b494a6686b00e03fe4c0848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:37:44.255719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:44.255719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a833f22-19f6-4855-96ed-757227e01a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:44.256661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1170/2331] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:37:43 2022] DELETE /identity/v3/projects/90ef1c7a5b494a6686b00e03fe4c0848 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:44.263503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770847a5-be17-456a-b49f-d2599c4bc030 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.264006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770847a5-be17-456a-b49f-d2599c4bc030 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.264160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770847a5-be17-456a-b49f-d2599c4bc030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.298387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-770847a5-be17-456a-b49f-d2599c4bc030 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:44.300070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-770847a5-be17-456a-b49f-d2599c4bc030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:44.369168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1162/2332] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:44.377815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e479e-18d1-4697-8406-32d7b02ef54f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.378337 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e479e-18d1-4697-8406-32d7b02ef54f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.378565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e479e-18d1-4697-8406-32d7b02ef54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.402842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-552e479e-18d1-4697-8406-32d7b02ef54f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:44.404246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-552e479e-18d1-4697-8406-32d7b02ef54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:44.413524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1171/2333] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:37:44.417827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770847a5-be17-456a-b49f-d2599c4bc030 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:44.436743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770847a5-be17-456a-b49f-d2599c4bc030 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:44.448230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:44.448990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.449370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.449742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.450501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:37:44.450904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:44.452869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:44.467923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1163/2334] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:37:44.472630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e479e-18d1-4697-8406-32d7b02ef54f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:44.482518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e479e-18d1-4697-8406-32d7b02ef54f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:44.488366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:44.489125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.489528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.489793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.490498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:44.492736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:44.610787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1172/2335] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:44 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:37:44.615766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:44.628069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb389f-0992-44e1-ac74-97bbfe2f6330 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:44.698356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:44.699472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.704904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.704904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.704904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:44.706754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:44.801297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1164/2336] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:44 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:44.805768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:44.825703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce30a3-9f36-485a-9249-c2d77800f1c7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:44.852891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:44.854499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.854827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.855132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.855865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:44.860229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:44.886216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1173/2337] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:44.887513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:44.905000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a86a8-98d0-45a7-ae5f-4fb8eefe3185 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:44.915484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc8a37-9afd-42d3-9da8-af311cacea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:44.917002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc8a37-9afd-42d3-9da8-af311cacea8d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.917409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc8a37-9afd-42d3-9da8-af311cacea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.917754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc8a37-9afd-42d3-9da8-af311cacea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.918498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc8a37-9afd-42d3-9da8-af311cacea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:44.920222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc8a37-9afd-42d3-9da8-af311cacea8d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:44.935396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1165/2338] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:44.944781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:44.955536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd272-2a73-4216-b634-137a83431d13 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:44.960688 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:44.961437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:44.961836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:44.962148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] PATH_INFO: `/v3/projects/1e90498000b5488b84e9bbd967b6afe1/users/41b6d5cebad24fe2a1f7436b77f91b6f/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:44.982628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e90498000b5488b84e9bbd967b6afe1, user_id=41b6d5cebad24fe2a1f7436b77f91b6f, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:44.985343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:45.058091 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1174/2339] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:44 2022] PUT /identity/v3/projects/1e90498000b5488b84e9bbd967b6afe1/users/41b6d5cebad24fe2a1f7436b77f91b6f/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:45.063512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:45.063512 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:45.064425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:45.087926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:45.089187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:45.133263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:45.155527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1166/2340] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:45.166875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:45.169132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:45.243391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996fbc4-ecda-4a15-b34c-7462b9014b3b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:45.255293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:45.255293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:45.255293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:45.255293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:45.270834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:45.270834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:45.291927 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1175/2341] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:50.494107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:50.496631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:50.512048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c9082-21f4-4d52-baad-aec69c218a1f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:50.521933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:50.524904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:50.524904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:50.524904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] PATH_INFO: `/v3/users/0b222ea5a1a343c58baf6d422f5bda35` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:50.526063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b222ea5a1a343c58baf6d422f5bda35)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:50.528808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:50.739265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b222ea5a1a343c58baf6d422f5bda35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:50.851274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b222ea5a1a343c58baf6d422f5bda35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:50.874750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b222ea5a1a343c58baf6d422f5bda35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:50.876055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b222ea5a1a343c58baf6d422f5bda35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:50.887662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b222ea5a1a343c58baf6d422f5bda35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:50.898909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1167/2342] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:37:50 2022] DELETE /identity/v3/users/0b222ea5a1a343c58baf6d422f5bda35 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:37:51.308951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:51.326547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e234f-eed8-4719-b68c-3d1514b76ee0 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:51.368947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:51.398890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:51.399588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:51.399915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:51.400213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] PATH_INFO: `/v3/projects/fb296eb79e1144788ea8ecdb65ce2c1c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:51.401371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb296eb79e1144788ea8ecdb65ce2c1c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:51.403394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:51.531059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb296eb79e1144788ea8ecdb65ce2c1c', 'request_id': 'req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:51.597283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb296eb79e1144788ea8ecdb65ce2c1c', 'request_id': 'req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:51.624299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb296eb79e1144788ea8ecdb65ce2c1c', 'request_id': 'req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:51.649700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] The token cache is being invalidate because project fb296eb79e1144788ea8ecdb65ce2c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:37:51.649946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:51.650600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-adb4e17b-7a90-4a7b-ada1-5b3f1f32150c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:51.652382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1176/2343] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:37:51 2022] DELETE /identity/v3/projects/fb296eb79e1144788ea8ecdb65ce2c1c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:51.657292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:51.660206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:51.685484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4eaeaf-6b1b-4077-94cd-4967be3641bb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:51.806470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:51.807627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:51.808533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:51.809086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] PATH_INFO: `/v3/users/fd196065bf7e426694863a3c0c04adff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:51.810606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd196065bf7e426694863a3c0c04adff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:51.812844 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:52.016354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd196065bf7e426694863a3c0c04adff'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.084328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:52.084680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:52.085008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:52.119005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] MFA Rules not processed for user `41b6d5cebad24fe2a1f7436b77f91b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:52.120459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:52.174669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd196065bf7e426694863a3c0c04adff'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.178186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:52.192840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd196065bf7e426694863a3c0c04adff'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.193673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd196065bf7e426694863a3c0c04adff'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.196215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1177/2344] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:52.200445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:52.201905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:52.207404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd196065bf7e426694863a3c0c04adff'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.214511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1168/2345] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:37:51 2022] DELETE /identity/v3/users/fd196065bf7e426694863a3c0c04adff => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:37:52.217203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d8938-2f7c-4064-b17f-459704b0fd74 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:52.277800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:52.289043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:52.289705 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:52.290024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:52.290335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:52.291004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:52.293572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:52.440240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1178/2346] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:52 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:37:52.445501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:52.447248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:52.461699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8c814-8005-41b5-955f-8f8d6aa13b22 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:52.526660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:52.527196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:52.527917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:52.528240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:52.528877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:52.530818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:52.537631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:52.539601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:52.555099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6d90b-37ff-431c-bdd6-b62e55f3c93d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:52.560506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:52.561202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:52.561489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:52.561763 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] PATH_INFO: `/v3/projects/1947783354d64efeba10395a4246e215` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:52.562920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1947783354d64efeba10395a4246e215)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:52.565947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:52.603805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1169/2347] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:52 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:52.607855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:52.617934 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eab846-7c76-43b0-8690-14e6f396daad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:52.622954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:52.623604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:52.623886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:52.624166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:52.625239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:52.627462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:52.638524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1170/2348] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:37:52.646611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:52.657215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7bd6e-40cc-41f7-bf82-5448c1ba15dd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:52.662316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:52.662978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:52.663256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:52.663562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] PATH_INFO: `/v3/projects/444640122e0c42c994bfc892c19fdb7b/users/bb1622989eb74d9da7b2d965da3209b6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:52.680603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444640122e0c42c994bfc892c19fdb7b, user_id=bb1622989eb74d9da7b2d965da3209b6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:52.683030 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:52.798975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1171/2349] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:52 2022] PUT /identity/v3/projects/444640122e0c42c994bfc892c19fdb7b/users/bb1622989eb74d9da7b2d965da3209b6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:37:52.799632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:52.820788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1947783354d64efeba10395a4246e215', 'request_id': 'req-b1649e30-235a-4fd1-89c6-1c91818da436'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.906031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1947783354d64efeba10395a4246e215', 'request_id': 'req-b1649e30-235a-4fd1-89c6-1c91818da436'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.907873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c262378-1ef5-413f-960d-6de0e17b2185 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:52.915650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1947783354d64efeba10395a4246e215', 'request_id': 'req-b1649e30-235a-4fd1-89c6-1c91818da436'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.935828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] The token cache is being invalidate because project 1947783354d64efeba10395a4246e215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:37:52.936342 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.937634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b1649e30-235a-4fd1-89c6-1c91818da436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:37:52.940673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1179/2350] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:37:52 2022] DELETE /identity/v3/projects/1947783354d64efeba10395a4246e215 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:37:52.949116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c176-a829-48db-8aff-25e0912ab307 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:52.949520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c176-a829-48db-8aff-25e0912ab307 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:52.949926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6c176-a829-48db-8aff-25e0912ab307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:52.963891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:52.982650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5ce6c176-a829-48db-8aff-25e0912ab307 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:52.985522 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5ce6c176-a829-48db-8aff-25e0912ab307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:53.010693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.011313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.012549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.012851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.013537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.015187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.036628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1172/2351] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:53.037184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:53.039648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:53.056052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5279916-3277-4611-b9dd-22669e0059eb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:53.069372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67318e88-9cd6-4d9d-a279-9691d5ceda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.069372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318e88-9cd6-4d9d-a279-9691d5ceda9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.069372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318e88-9cd6-4d9d-a279-9691d5ceda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.069372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67318e88-9cd6-4d9d-a279-9691d5ceda9b admin admin] PATH_INFO: `/v3/projects/444640122e0c42c994bfc892c19fdb7b/users/bb1622989eb74d9da7b2d965da3209b6/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.069832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67318e88-9cd6-4d9d-a279-9691d5ceda9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=444640122e0c42c994bfc892c19fdb7b, user_id=bb1622989eb74d9da7b2d965da3209b6, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.071316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67318e88-9cd6-4d9d-a279-9691d5ceda9b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.090313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1173/2352] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:53 2022] PUT /identity/v3/projects/444640122e0c42c994bfc892c19fdb7b/users/bb1622989eb74d9da7b2d965da3209b6/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:53.115854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1180/2353] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:53.124182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddff47f-133d-4c73-9fa5-b1790feccbf9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.124708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddff47f-133d-4c73-9fa5-b1790feccbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.125017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddff47f-133d-4c73-9fa5-b1790feccbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.149202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fddff47f-133d-4c73-9fa5-b1790feccbf9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:53.150524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fddff47f-133d-4c73-9fa5-b1790feccbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:53.228677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1174/2354] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:53.230046 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c176-a829-48db-8aff-25e0912ab307 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:53.242304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6c176-a829-48db-8aff-25e0912ab307 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:53.253747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.254459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.256130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.256510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.259057 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:37:53.259529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.265100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.304353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1181/2355] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:37:53.309589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddff47f-133d-4c73-9fa5-b1790feccbf9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:53.325093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddff47f-133d-4c73-9fa5-b1790feccbf9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:53.330682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.331482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.331774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.332142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.332906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.334962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.446270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1175/2356] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:53 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:37:53.451139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:53.466691 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b55bc5-20f8-432b-a1fe-222a80a91a9e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:53.546650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:53.575834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.576762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.577205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.577666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.578480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.581574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.653863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1182/2357] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:53 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:53.658841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:53.671323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76af3b5-5028-4ad4-ba71-7e297cdbf969 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:53.679245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.680096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.680431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.680699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.681815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.683542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.696582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1176/2358] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:53.705193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:53.717677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5820-2251-4c11-aa57-d5f22375c789 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:53.725589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ec5c-24fe-4f33-8a40-a022321ef723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.729078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ec5c-24fe-4f33-8a40-a022321ef723 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.729078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ec5c-24fe-4f33-8a40-a022321ef723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.729078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ec5c-24fe-4f33-8a40-a022321ef723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.729078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ec5c-24fe-4f33-8a40-a022321ef723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.730384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ec5c-24fe-4f33-8a40-a022321ef723 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.745917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1183/2359] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:37:53.750354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:53.762857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c0385-6e87-4ce2-b34c-b025db0d010a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:53.769655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:53.770666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.771161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.771655 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] PATH_INFO: `/v3/projects/71850f5c24104e1f9dcad83e1d13bf9d/users/0be1f801df054ba8ad881614cbeecfad/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.796864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71850f5c24104e1f9dcad83e1d13bf9d, user_id=0be1f801df054ba8ad881614cbeecfad, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:53.801910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:53.925810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1177/2360] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:53 2022] PUT /identity/v3/projects/71850f5c24104e1f9dcad83e1d13bf9d/users/0be1f801df054ba8ad881614cbeecfad/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:53.937343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156cef-6ada-4986-a06d-c9341fb443aa None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:53.937852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156cef-6ada-4986-a06d-c9341fb443aa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:53.938203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156cef-6ada-4986-a06d-c9341fb443aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:53.977138 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-87156cef-6ada-4986-a06d-c9341fb443aa None None] MFA Rules not processed for user `0be1f801df054ba8ad881614cbeecfad`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:53.978856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-87156cef-6ada-4986-a06d-c9341fb443aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:54.062957 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1184/2361] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:54.072472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:54.151793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210054d6-3af6-4573-8f09-293aee87cc23 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:54.156732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:54.157344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:54.158178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:54.158489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:54.159140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:54.161143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:54.167089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:54.266806 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1178/2362] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:54 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:54.271314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87156cef-6ada-4986-a06d-c9341fb443aa None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:54.284664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87156cef-6ada-4986-a06d-c9341fb443aa None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:54.368904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:54.369712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:54.369909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:54.370182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:54.370895 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:54.372935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:54.512359 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1185/2363] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:54 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:37:54.516370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:54.527141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90cb4-d224-4534-a231-fb9ae9edde65 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:54.531789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:54.532416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:54.532817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:54.533152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:54.533815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:54.535412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:54.545997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1179/2364] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:54.550781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:54.561011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c107d-ecaf-4ec0-9047-bf1f598ee43d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:54.566156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8ff73-1908-4790-88e2-f2bfd9eb69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:54.567012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8ff73-1908-4790-88e2-f2bfd9eb69ec admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:54.567415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8ff73-1908-4790-88e2-f2bfd9eb69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:54.567685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8ff73-1908-4790-88e2-f2bfd9eb69ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:54.568331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8ff73-1908-4790-88e2-f2bfd9eb69ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:54.569944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8ff73-1908-4790-88e2-f2bfd9eb69ec admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:54.580306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1186/2365] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:54.584658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:54.595085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd203a-03cc-4f85-ab48-7eced7839f9b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:54.602345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:54.603038 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:54.603323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:54.607033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] PATH_INFO: `/v3/projects/153953befc2a4d35b4ca6885797e5c43/users/a31ddf1cfacc4d9b85dcce87d57be022/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:54.624975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] RBAC: Authorizing `identity:create_grant(project_id=153953befc2a4d35b4ca6885797e5c43, user_id=a31ddf1cfacc4d9b85dcce87d57be022, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:54.628351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:54.808876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1180/2366] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:54 2022] PUT /identity/v3/projects/153953befc2a4d35b4ca6885797e5c43/users/a31ddf1cfacc4d9b85dcce87d57be022/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:54.821644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5b44-b771-4976-bb79-0ca44190d038 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:54.821644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5b44-b771-4976-bb79-0ca44190d038 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:54.832746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f5b44-b771-4976-bb79-0ca44190d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:54.855675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9f3f5b44-b771-4976-bb79-0ca44190d038 None None] MFA Rules not processed for user `a31ddf1cfacc4d9b85dcce87d57be022`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:54.857079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9f3f5b44-b771-4976-bb79-0ca44190d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:54.900391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:54.964141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1187/2367] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:54.968611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:55.118229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd8197-b0f3-4225-93a4-e8cc995e758f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:55.125753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:55.126852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:55.128259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:55.128259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:55.128493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:55.130674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:55.241525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f5b44-b771-4976-bb79-0ca44190d038 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:55.250509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1181/2368] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:37:54 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:55.263535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f5b44-b771-4976-bb79-0ca44190d038 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:55.401752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:55.401955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:55.402227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:55.402506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:55.403241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:55.405229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:55.484484 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1188/2369] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:37:55 2022] POST /identity/v3/users => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:37:55.490219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:55.504244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abcb8b-23dd-4392-9bad-f5e4e67a64f5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:55.511316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:55.511974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:55.512254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:55.512526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:55.513299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:55.515258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:55.539112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1182/2370] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:37:55.543306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:55.558275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e6afc-ac9d-4704-9ffb-4539bb990c88 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:55.574623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:55.575742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:55.576023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:55.576327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] PATH_INFO: `/v3/projects/aa17490712804944bc86394a8f5c5f0c/users/63e8a8bbf1d9496693a23fb54c76b89a/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:55.607194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa17490712804944bc86394a8f5c5f0c, user_id=63e8a8bbf1d9496693a23fb54c76b89a, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:55.610180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:55.844469 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1189/2371] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:55 2022] PUT /identity/v3/projects/aa17490712804944bc86394a8f5c5f0c/users/63e8a8bbf1d9496693a23fb54c76b89a/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:55.849567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:55.861318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc538-9977-43e9-8ef4-426847779d39 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:55.936400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdacded-41e9-4057-b01b-271642c3cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:55.937361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacded-41e9-4057-b01b-271642c3cf3f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:55.937718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacded-41e9-4057-b01b-271642c3cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:55.938061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdacded-41e9-4057-b01b-271642c3cf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:55.938793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdacded-41e9-4057-b01b-271642c3cf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:55.941698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdacded-41e9-4057-b01b-271642c3cf3f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:55.952963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1183/2372] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:37:55.957603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:55.973981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df56bd-8bbe-496a-beac-95c75ea2c16e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:55.980310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:55.980999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:55.981280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:55.981554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] PATH_INFO: `/v3/projects/aa17490712804944bc86394a8f5c5f0c/users/63e8a8bbf1d9496693a23fb54c76b89a/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:55.983765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa17490712804944bc86394a8f5c5f0c, user_id=63e8a8bbf1d9496693a23fb54c76b89a, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:55.987322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:56.016415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1190/2373] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:37:55 2022] PUT /identity/v3/projects/aa17490712804944bc86394a8f5c5f0c/users/63e8a8bbf1d9496693a23fb54c76b89a/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:37:56.028496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e78a-ab90-499d-93bd-0009e5e6cd1d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:56.028943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e78a-ab90-499d-93bd-0009e5e6cd1d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:56.029226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43e78a-ab90-499d-93bd-0009e5e6cd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:56.083205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cd43e78a-ab90-499d-93bd-0009e5e6cd1d None None] MFA Rules not processed for user `63e8a8bbf1d9496693a23fb54c76b89a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:56.084490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cd43e78a-ab90-499d-93bd-0009e5e6cd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:56.097359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:56.171505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1184/2374] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:37:56.183328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:37:56.185360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:37:56.326855 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc437b8-d869-4219-92ed-afccf485105d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:37:56.338977 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:37:56.339950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:56.340426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:56.340843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:56.396361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:37:56.426148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:37:56.427898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:37:56.438590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1191/2375] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:37:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:37:59.887851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:37:59.888734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:37:59.889162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:37:59.921877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] MFA Rules not processed for user `bb1622989eb74d9da7b2d965da3209b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:37:59.924062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:00.006613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:00.016575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2d5be-aa15-4065-8d61-e7973da57046 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:00.023086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792add2-ff77-4603-87ef-27a966c55c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:00.023683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792add2-ff77-4603-87ef-27a966c55c8e service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:00.023965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792add2-ff77-4603-87ef-27a966c55c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:00.024238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792add2-ff77-4603-87ef-27a966c55c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:00.036675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1185/2376] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:37:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:00.051330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:00.056511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:00.107224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792add2-ff77-4603-87ef-27a966c55c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:00.108789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792add2-ff77-4603-87ef-27a966c55c8e service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:00.119080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1192/2377] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:38:00.140007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e4cb-1e61-4160-bd93-b0f53e5f83a2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:00.144774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:00.146820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:00.147114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:00.147446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:00.149425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:00.239058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:00.259539 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:00.261352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:00.272194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1186/2378] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:00.640749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cbd1-a9aa-43fb-94ff-45268f9af72b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:00.641193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cbd1-a9aa-43fb-94ff-45268f9af72b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:00.641541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713cbd1-a9aa-43fb-94ff-45268f9af72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:00.663284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c713cbd1-a9aa-43fb-94ff-45268f9af72b None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:00.664082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c713cbd1-a9aa-43fb-94ff-45268f9af72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:00.741774 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1193/2379] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:00.802513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:00.804139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:00.918178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48df445-4198-43b0-8a29-28e45ea8ede0 service glance] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:00.924748 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:00.925644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:00.925766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:00.926058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:00.935156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:00.936895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:00.955071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1187/2380] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:38:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:38:02.475567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713cbd1-a9aa-43fb-94ff-45268f9af72b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:02.491784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713cbd1-a9aa-43fb-94ff-45268f9af72b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:02.496279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d32bc-7781-412e-8502-1a2998d08352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:02.497309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d32bc-7781-412e-8502-1a2998d08352 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:02.497309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d32bc-7781-412e-8502-1a2998d08352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:02.497749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d32bc-7781-412e-8502-1a2998d08352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:02.512635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d32bc-7781-412e-8502-1a2998d08352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:02.514109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d32bc-7781-412e-8502-1a2998d08352 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:02.543226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1194/2381] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:07.898618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:07.898618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:07.937616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0bb5-72ab-4a02-aa6d-938b55c8fd52 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:07.943168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:07.943833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:07.944115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:07.944392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] PATH_INFO: `/v3/users/e007f0a7589c45d0a39f7dc6b514042c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:07.945532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e007f0a7589c45d0a39f7dc6b514042c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:07.947703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:08.463274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e007f0a7589c45d0a39f7dc6b514042c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:08.535329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e007f0a7589c45d0a39f7dc6b514042c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:08.560246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e007f0a7589c45d0a39f7dc6b514042c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:08.561821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e007f0a7589c45d0a39f7dc6b514042c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:08.610015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:08.614458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e007f0a7589c45d0a39f7dc6b514042c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:08.622077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1188/2382] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:38:07 2022] DELETE /identity/v3/users/e007f0a7589c45d0a39f7dc6b514042c => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:08.626701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:08.627269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:08.627494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:08.648904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:08.650820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:08.728318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1195/2383] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:08.735618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:08.737145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:08.822252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097feaea-f3f7-4b72-9a6a-92de02d40e55 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:08.826946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:08.827590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:08.827893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:08.828165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:08.842306 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:08.844197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:08.858075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1189/2384] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:38:09.447623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:09.449299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:09.461560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:09.471872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fc6e-190c-47c9-8ec5-11643b0d045e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:09.481475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:09.481475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:09.481475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:09.481475 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] PATH_INFO: `/v3/projects/265b6dcf44e742f7bd83f61da3c2791e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:09.481898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265b6dcf44e742f7bd83f61da3c2791e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:09.484550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:09.671563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265b6dcf44e742f7bd83f61da3c2791e', 'request_id': 'req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:09.697699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:09.699200 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:09.716328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c56dd-960b-4aab-9e95-497ae83e5bb3 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:09.800482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:09.801500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:09.801931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:09.802216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] PATH_INFO: `/v3/users/0be1f801df054ba8ad881614cbeecfad` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:09.804155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be1f801df054ba8ad881614cbeecfad)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:09.806135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:09.820218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265b6dcf44e742f7bd83f61da3c2791e', 'request_id': 'req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:09.828541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265b6dcf44e742f7bd83f61da3c2791e', 'request_id': 'req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:09.853381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] The token cache is being invalidate because project 265b6dcf44e742f7bd83f61da3c2791e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:38:09.854047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:09.859288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ed9385f0-56c9-4f8f-b23e-37ae1b82e405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:09.865191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1196/2385] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:38:09 2022] DELETE /identity/v3/projects/265b6dcf44e742f7bd83f61da3c2791e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:09.866949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b117d86-32bc-4a7a-8ecf-ebbc0c7b28ea None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:09.867333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b117d86-32bc-4a7a-8ecf-ebbc0c7b28ea None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:09.867707 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b117d86-32bc-4a7a-8ecf-ebbc0c7b28ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:09.898473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4b117d86-32bc-4a7a-8ecf-ebbc0c7b28ea None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:09.900106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b117d86-32bc-4a7a-8ecf-ebbc0c7b28ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:09.910807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1197/2386] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:09.919613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a45844-0db8-480a-9648-d5a00b623afa None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:09.920147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a45844-0db8-480a-9648-d5a00b623afa None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:09.920652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a45844-0db8-480a-9648-d5a00b623afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:09.951823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f4a45844-0db8-480a-9648-d5a00b623afa None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:09.956498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f4a45844-0db8-480a-9648-d5a00b623afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:09.963931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1198/2387] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:09.969746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a45844-0db8-480a-9648-d5a00b623afa None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:09.983381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a45844-0db8-480a-9648-d5a00b623afa None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:09.989267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:09.990444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:09.990800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:09.991170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:09.991941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:38:09.992315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:09.993993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.012148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1199/2388] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:38:10.017579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:10.029476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9035624-1530-41db-97f8-8a1916315d89 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:10.035169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:10.035823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.036098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.036365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.037065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:10.039048 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.077051 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be1f801df054ba8ad881614cbeecfad'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:10.175231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be1f801df054ba8ad881614cbeecfad'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:10.188116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1200/2389] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:38:10 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:38:10.191826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:10.200869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be1f801df054ba8ad881614cbeecfad'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:10.201980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be1f801df054ba8ad881614cbeecfad'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:10.214629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bf408fd0-6b22-4595-a350-87f3b68c15b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be1f801df054ba8ad881614cbeecfad'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:10.223409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1190/2390] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:38:09 2022] DELETE /identity/v3/users/0be1f801df054ba8ad881614cbeecfad => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:38:10.235693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.236337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.236725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.278103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:10.279664 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:10.301348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:10.314501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b96cb6-102d-4a99-a40e-56f3e2cd5f5b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:10.370884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1191/2391] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:10.391139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:10.393705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:10.395002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:10.425159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:10.426249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.426249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.426503 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.427077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:10.429500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.483878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f304a61-ee84-4d64-92a5-d70c5fea013a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:10.488777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f1f4-587f-44ac-924b-ef8d71f45fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:10.489448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f1f4-587f-44ac-924b-ef8d71f45fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.489756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f1f4-587f-44ac-924b-ef8d71f45fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.490052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f1f4-587f-44ac-924b-ef8d71f45fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.502832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f1f4-587f-44ac-924b-ef8d71f45fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:10.505779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288f1f4-587f-44ac-924b-ef8d71f45fe0 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.525739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1192/2392] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:10.527555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.528017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.528450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.575813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1201/2393] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:38:10 2022] POST /identity/v3/users => generated 287 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:38:10.579220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:10.579220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:10.584137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:10.590335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:10.609204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e63f7-173d-498f-8350-57484c4bc05a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:10.618390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:10.619025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.619382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.620171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.620853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:10.622937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.638920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1202/2394] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:38:10.643777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:10.667976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a0cc-c708-443b-9b8f-1369a1123e5a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:10.682177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:10.683098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.683498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.689629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.689629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:10.689629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.722320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1203/2395] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:38:10.727063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1193/2396] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:10.730381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:10.748230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:10.750548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:10.757479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f75d57-bd13-4a17-b801-e6c9c5f3c6fd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:10.770343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:10.771637 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.771923 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.772364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] PATH_INFO: `/v3/projects/e5df5167c37f4323b152abd198cae653/users/4154de3c530347e09203195fd6baf23a/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.805615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5df5167c37f4323b152abd198cae653, user_id=4154de3c530347e09203195fd6baf23a, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:10.808852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.870813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2be0b7-0d70-42fb-a4aa-60f661f9ea18 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:10.873489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31747917-846e-4ed2-be59-2d6df0b78acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:10.874204 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747917-846e-4ed2-be59-2d6df0b78acc service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.874993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747917-846e-4ed2-be59-2d6df0b78acc service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.875362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31747917-846e-4ed2-be59-2d6df0b78acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.889490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31747917-846e-4ed2-be59-2d6df0b78acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:10.891248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31747917-846e-4ed2-be59-2d6df0b78acc service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:10.905462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1194/2397] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:38:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:38:10.917783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1204/2398] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:38:10 2022] PUT /identity/v3/projects/e5df5167c37f4323b152abd198cae653/users/4154de3c530347e09203195fd6baf23a/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:10.934659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:10.934948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:10.935224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:10.943888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:10.981380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] MFA Rules not processed for user `4154de3c530347e09203195fd6baf23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:10.982732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:11.091928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1195/2399] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:11.104386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:11.106220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:11.182830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847601f9-b536-4f0e-8f00-0be4e6a46338 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:11.186542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:11.187163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:11.187481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:11.187919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:11.199429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:11.201002 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:11.213309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1205/2400] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:11.268181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:11.270999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:11.484999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed921e40-949e-4afa-a19b-88c25f8f397b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:11.484999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:11.484999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:11.484999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:11.486116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] PATH_INFO: `/v3/projects/71850f5c24104e1f9dcad83e1d13bf9d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:11.486116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71850f5c24104e1f9dcad83e1d13bf9d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:11.486116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:12.327454 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71850f5c24104e1f9dcad83e1d13bf9d', 'request_id': 'req-6d028a16-e2ed-4c85-939d-6fe8fdb90662'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.448582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71850f5c24104e1f9dcad83e1d13bf9d', 'request_id': 'req-6d028a16-e2ed-4c85-939d-6fe8fdb90662'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.455483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71850f5c24104e1f9dcad83e1d13bf9d', 'request_id': 'req-6d028a16-e2ed-4c85-939d-6fe8fdb90662'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.477062 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] The token cache is being invalidate because project 71850f5c24104e1f9dcad83e1d13bf9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:38:12.479711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.479711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.483840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1196/2401] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:38:11 2022] DELETE /identity/v3/projects/71850f5c24104e1f9dcad83e1d13bf9d => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:12.484804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:12.503119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6825e-269a-48fc-a776-97e7db94e59d service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:12.608247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:12.608999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:12.609389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:12.609727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] PATH_INFO: `/v3/users/a31ddf1cfacc4d9b85dcce87d57be022` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:12.612031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31ddf1cfacc4d9b85dcce87d57be022)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:12.614394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:12.880454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:12.917997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31ddf1cfacc4d9b85dcce87d57be022'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.919293 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31ddf1cfacc4d9b85dcce87d57be022'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.935581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31ddf1cfacc4d9b85dcce87d57be022'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:12.967941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31ddf1cfacc4d9b85dcce87d57be022'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:13.220618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-56cda9c4-5403-4496-b337-f29d50f75f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31ddf1cfacc4d9b85dcce87d57be022'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:13.231145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1206/2402] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:38:12 2022] DELETE /identity/v3/users/a31ddf1cfacc4d9b85dcce87d57be022 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:38:13.948083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:13.951188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:13.973505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028a16-e2ed-4c85-939d-6fe8fdb90662 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:13.982122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:13.983017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:13.983548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:14.019459 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:14.020901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] MFA Rules not processed for user `41b6d5cebad24fe2a1f7436b77f91b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:14.024928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:14.112715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:14.113509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:14.113827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:14.114088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] PATH_INFO: `/v3/projects/153953befc2a4d35b4ca6885797e5c43` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:14.116235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=153953befc2a4d35b4ca6885797e5c43)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:14.118610 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:14.124358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1207/2403] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:38:14.280169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153953befc2a4d35b4ca6885797e5c43', 'request_id': 'req-a2913668-660d-4054-87c9-d492353fe7c6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:14.357629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153953befc2a4d35b4ca6885797e5c43', 'request_id': 'req-a2913668-660d-4054-87c9-d492353fe7c6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:14.392626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153953befc2a4d35b4ca6885797e5c43', 'request_id': 'req-a2913668-660d-4054-87c9-d492353fe7c6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:14.410681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] The token cache is being invalidate because project 153953befc2a4d35b4ca6885797e5c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:38:14.411074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:14.411887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-a2913668-660d-4054-87c9-d492353fe7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:14.416605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1197/2404] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:38:13 2022] DELETE /identity/v3/projects/153953befc2a4d35b4ca6885797e5c43 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:14.417856 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:14.419883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:14.464506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8657f8-2d4b-4f62-934d-fcd3cd0464dd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:14.603878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:14.604870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:14.605148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:14.605425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] PATH_INFO: `/v3/users/63e8a8bbf1d9496693a23fb54c76b89a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:14.606579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e8a8bbf1d9496693a23fb54c76b89a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:14.608763 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:15.194968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:15.194968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:15.194968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:15.213308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] MFA Rules not processed for user `4154de3c530347e09203195fd6baf23a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:15.224021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:15.274847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1198/2405] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:38:15.557991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e8a8bbf1d9496693a23fb54c76b89a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:15.558838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e8a8bbf1d9496693a23fb54c76b89a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:15.571006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e8a8bbf1d9496693a23fb54c76b89a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:15.577340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:15.601499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e8a8bbf1d9496693a23fb54c76b89a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:15.780644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-7a631329-d38a-47d1-80b9-f94f8b3b6228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e8a8bbf1d9496693a23fb54c76b89a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:15.790542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1208/2406] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:38:14 2022] DELETE /identity/v3/users/63e8a8bbf1d9496693a23fb54c76b89a => generated 0 bytes in 1373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:16.406345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:16.408692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:16.439215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a053bb7-7d4e-4d6f-a3e8-a76080300394 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:16.504559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:16.521598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:16.522623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:16.523075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:16.524270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] PATH_INFO: `/v3/projects/aa17490712804944bc86394a8f5c5f0c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:16.527147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa17490712804944bc86394a8f5c5f0c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:16.529399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:16.692098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa17490712804944bc86394a8f5c5f0c', 'request_id': 'req-3fd66fc1-d655-49bc-99bd-302c70b53b0e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:16.780048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa17490712804944bc86394a8f5c5f0c', 'request_id': 'req-3fd66fc1-d655-49bc-99bd-302c70b53b0e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:16.787117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa17490712804944bc86394a8f5c5f0c', 'request_id': 'req-3fd66fc1-d655-49bc-99bd-302c70b53b0e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:16.801909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] The token cache is being invalidate because project aa17490712804944bc86394a8f5c5f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:38:16.802183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:16.802841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-3fd66fc1-d655-49bc-99bd-302c70b53b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:38:16.804367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1199/2407] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:38:16 2022] DELETE /identity/v3/projects/aa17490712804944bc86394a8f5c5f0c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:16.811960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1303c-29da-451c-b51b-293932c442ee None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:16.812847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1303c-29da-451c-b51b-293932c442ee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:16.812847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1303c-29da-451c-b51b-293932c442ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:16.836606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-62a1303c-29da-451c-b51b-293932c442ee None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:16.837871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-62a1303c-29da-451c-b51b-293932c442ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:16.917092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1209/2408] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:16.930056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d19f-4082-48d6-aa2b-812b61c54fa4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:16.933919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d19f-4082-48d6-aa2b-812b61c54fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:16.934319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d19f-4082-48d6-aa2b-812b61c54fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:16.978740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b070d19f-4082-48d6-aa2b-812b61c54fa4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:16.980633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b070d19f-4082-48d6-aa2b-812b61c54fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:16.993396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1200/2409] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:17.007930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1303c-29da-451c-b51b-293932c442ee None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.033184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1303c-29da-451c-b51b-293932c442ee None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.043267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.043932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.044271 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.044550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.045226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:38:17.045544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.048417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.076117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1210/2410] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:38:17.077403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070d19f-4082-48d6-aa2b-812b61c54fa4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.091845 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070d19f-4082-48d6-aa2b-812b61c54fa4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.097813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.098444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.098724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.098996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.099687 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.101620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.207690 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1201/2411] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:38:17 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:38:17.213667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.246449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332568-ab18-4684-a3da-0fdf37c4929c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.331634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.332709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.332709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.333066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.334346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.336471 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.447967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1211/2412] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:38:17 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:38:17.449707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.461465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766078f6-cc75-4a5e-b96b-89503f213010 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.466485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.467233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.467566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.467840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.468491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.470747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.481761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1202/2413] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:38:17.487089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.498738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ccd58-7b33-4489-829a-e1fdf6226647 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.503817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.504429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.506737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.506737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.506737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.507208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.520189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1212/2414] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:38:17.524517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.541732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff9b60-09e2-46b6-bf08-b85879159f85 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.547061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26e041-415f-40d8-add3-1da3f73d2855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.548487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e041-415f-40d8-add3-1da3f73d2855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.548621 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e041-415f-40d8-add3-1da3f73d2855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.548812 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e041-415f-40d8-add3-1da3f73d2855 admin admin] PATH_INFO: `/v3/projects/81d3d2ee03e946248cbb8c2caceba6a9/users/faef1e93f5d14936b03eec5200765e35/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.555148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.557097 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:17.569735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e041-415f-40d8-add3-1da3f73d2855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d3d2ee03e946248cbb8c2caceba6a9, user_id=faef1e93f5d14936b03eec5200765e35, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.572725 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e041-415f-40d8-add3-1da3f73d2855 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.607236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:17.643672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316834d1-ec0d-4c07-805e-a86af52126cb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.659526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.661309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1203/2415] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:38:17 2022] PUT /identity/v3/projects/81d3d2ee03e946248cbb8c2caceba6a9/users/faef1e93f5d14936b03eec5200765e35/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:38:17.664971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.665197 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.665443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.667930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58371ab3-9659-4aaa-9511-7f003296e903 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.668515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:17.668667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58371ab3-9659-4aaa-9511-7f003296e903 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.669040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58371ab3-9659-4aaa-9511-7f003296e903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.692617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.694381 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.698274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-58371ab3-9659-4aaa-9511-7f003296e903 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:17.699669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-58371ab3-9659-4aaa-9511-7f003296e903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:17.725557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1213/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:38:17.816142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1204/2417] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:17.826322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:17.828481 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:17.895509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b234565-8dc2-4b4c-8589-0dd1dbfcfad0 service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:17.964607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:17.965224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:17.965500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:17.965765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:17.977524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:17.979966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:17.994188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1214/2418] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:19.547021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe0eb5-5b5a-4999-83f9-0c1ee6d1e62b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:19.548116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe0eb5-5b5a-4999-83f9-0c1ee6d1e62b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:19.548541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe0eb5-5b5a-4999-83f9-0c1ee6d1e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:19.696814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2ffe0eb5-5b5a-4999-83f9-0c1ee6d1e62b None None] MFA Rules not processed for user `faef1e93f5d14936b03eec5200765e35`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:19.698101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ffe0eb5-5b5a-4999-83f9-0c1ee6d1e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:19.728095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:19.846656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1205/2419] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:19.862801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:19.864420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:19.934884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960844-d55f-407a-916d-aaf529193e20 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:19.940608 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:19.941389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:19.941681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:19.941932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:19.953226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:19.955798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:19.967921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1215/2420] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:20.901362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a13d-ac19-4e55-bdc4-02a4f4937ed6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:20.901883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a13d-ac19-4e55-bdc4-02a4f4937ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:20.901883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a13d-ac19-4e55-bdc4-02a4f4937ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:20.926682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f0d4a13d-ac19-4e55-bdc4-02a4f4937ed6 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:20.927969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f0d4a13d-ac19-4e55-bdc4-02a4f4937ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:21.185774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1206/2421] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:38:21.213768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:21.213768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:21.319499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:21.441870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cc16f-7568-4d46-b007-4b4555ba9823 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:21.451080 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca864e-390a-4724-929c-c5b24aae17e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:21.451778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca864e-390a-4724-929c-c5b24aae17e6 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:21.452045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca864e-390a-4724-929c-c5b24aae17e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:21.452320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca864e-390a-4724-929c-c5b24aae17e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:21.475395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca864e-390a-4724-929c-c5b24aae17e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:21.479226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca864e-390a-4724-929c-c5b24aae17e6 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:21.494838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1216/2422] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:38:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:38:23.347556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fcf2-b611-4906-9bcc-a1920a73624a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:23.348126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fcf2-b611-4906-9bcc-a1920a73624a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:23.348126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fcf2-b611-4906-9bcc-a1920a73624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:23.434388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-30a1fcf2-b611-4906-9bcc-a1920a73624a None None] MFA Rules not processed for user `faef1e93f5d14936b03eec5200765e35`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:23.441784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-30a1fcf2-b611-4906-9bcc-a1920a73624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:23.576322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1207/2423] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:31.494986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=18 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:33.396147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=52 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:46.296593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9a2a1-ecaa-440f-96cf-3618741591b9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.297225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9a2a1-ecaa-440f-96cf-3618741591b9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.297225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9a2a1-ecaa-440f-96cf-3618741591b9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.299053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1217/2424] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:38:46.305142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03b0b-ad6e-4117-a64f-b96f8a37b270 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.306034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03b0b-ad6e-4117-a64f-b96f8a37b270 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.306034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd03b0b-ad6e-4117-a64f-b96f8a37b270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.330174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9fd03b0b-ad6e-4117-a64f-b96f8a37b270 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:46.331383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9fd03b0b-ad6e-4117-a64f-b96f8a37b270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:46.409048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1208/2425] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:46.420967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9a2a1-ecaa-440f-96cf-3618741591b9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:46.423258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d5c9a2a1-ecaa-440f-96cf-3618741591b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:46.499878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9a2a1-ecaa-440f-96cf-3618741591b9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:46.499878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d0ed3-52eb-4014-85a6-8af7f25009b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:46.499878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d0ed3-52eb-4014-85a6-8af7f25009b6 service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.499878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d0ed3-52eb-4014-85a6-8af7f25009b6 service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.500248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d0ed3-52eb-4014-85a6-8af7f25009b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.505202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d0ed3-52eb-4014-85a6-8af7f25009b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:46.510173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d0ed3-52eb-4014-85a6-8af7f25009b6 service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:46.518831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1218/2426] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:46.764032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87ffd-adb2-4862-85d4-2cc0d2c13238 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.764457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87ffd-adb2-4862-85d4-2cc0d2c13238 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.765217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87ffd-adb2-4862-85d4-2cc0d2c13238 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.767583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1209/2427] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:38:46.780071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6225-8059-4973-8c99-90fae02cc49c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.780071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6225-8059-4973-8c99-90fae02cc49c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.780071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6225-8059-4973-8c99-90fae02cc49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.802507 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-aefd6225-8059-4973-8c99-90fae02cc49c None None] MFA Rules not processed for user `5c06385b20074363b3a5f7216947280b`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:46.808534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-aefd6225-8059-4973-8c99-90fae02cc49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:46.810594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1219/2428] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:46.824381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87ffd-adb2-4862-85d4-2cc0d2c13238 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:46.825782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-edd87ffd-adb2-4862-85d4-2cc0d2c13238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:46.848217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87ffd-adb2-4862-85d4-2cc0d2c13238 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:46.852041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c6b8-88c3-402b-954b-c72446900253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:46.852733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c6b8-88c3-402b-954b-c72446900253 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.853059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c6b8-88c3-402b-954b-c72446900253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.853423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c6b8-88c3-402b-954b-c72446900253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.861813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c6b8-88c3-402b-954b-c72446900253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:46.863254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c6b8-88c3-402b-954b-c72446900253 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:46.871879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1210/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:46.961788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb583ad-9d7b-40e1-a811-0ec88a8a0ce1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.962064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb583ad-9d7b-40e1-a811-0ec88a8a0ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.962331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb583ad-9d7b-40e1-a811-0ec88a8a0ce1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.963734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1220/2430] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:38:46.969954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a1fd4-2e55-43c4-8759-c23d661d35f7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:46.970250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a1fd4-2e55-43c4-8759-c23d661d35f7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:46.970522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a1fd4-2e55-43c4-8759-c23d661d35f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:46.991194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fb7a1fd4-2e55-43c4-8759-c23d661d35f7 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:38:46.992461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb7a1fd4-2e55-43c4-8759-c23d661d35f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:38:47.002238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1211/2431] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:38:47.013173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb583ad-9d7b-40e1-a811-0ec88a8a0ce1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:38:47.025351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb583ad-9d7b-40e1-a811-0ec88a8a0ce1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:38:47.030330 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:38:47.030951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:38:47.031230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:38:47.031538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:38:47.043760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:38:47.045258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:38:47.057078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1221/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:38:56.985794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=40 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:38:57.052198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=35 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:39:03.253700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6de6c9-bf20-4f82-9fe4-0245c2ba3ee9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:03.254240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6de6c9-bf20-4f82-9fe4-0245c2ba3ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:03.254345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6de6c9-bf20-4f82-9fe4-0245c2ba3ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:03.276562 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ae6de6c9-bf20-4f82-9fe4-0245c2ba3ee9 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:03.277961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ae6de6c9-bf20-4f82-9fe4-0245c2ba3ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:03.286471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1212/2433] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:03.315614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:03.327292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5f183-7959-48df-bd48-cb7b256ea3d2 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:03.333871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:03.334498 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:03.334769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:03.335045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:03.344737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:03.346369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:03.360444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1222/2434] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:39:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:39:05.321229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6de6c9-bf20-4f82-9fe4-0245c2ba3ee9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:05.328798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6de6c9-bf20-4f82-9fe4-0245c2ba3ee9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:05.332716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b15b76-adf1-4520-82a1-c64f1d57960b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:05.333332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b15b76-adf1-4520-82a1-c64f1d57960b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:05.333605 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b15b76-adf1-4520-82a1-c64f1d57960b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:05.333871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b15b76-adf1-4520-82a1-c64f1d57960b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:05.335662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-11b15b76-adf1-4520-82a1-c64f1d57960b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:05.448234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b15b76-adf1-4520-82a1-c64f1d57960b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:05.449923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b15b76-adf1-4520-82a1-c64f1d57960b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:05.462624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1213/2435] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:39:13.352603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:39:15.456328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=33 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:39:26.876578 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:26.894195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef91b4-94b1-4e6e-b6aa-3bd5ee893228 service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:26.899379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:26.900000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:26.900284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:26.900558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:26.902926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:26.917493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:26.919056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:26.931109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1223/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:39:28.367159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6d5a-6ed0-4876-9903-694e96d23833 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:28.367695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6d5a-6ed0-4876-9903-694e96d23833 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:28.367801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6d5a-6ed0-4876-9903-694e96d23833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:28.387757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-04dc6d5a-6ed0-4876-9903-694e96d23833 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:28.390520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-04dc6d5a-6ed0-4876-9903-694e96d23833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:28.396319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1214/2437] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:39:28.409819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:28.426672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b6594-a912-4918-a56c-e5fb4c363fde service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:28.438760 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9d876-09cb-4d38-9f34-9b0ac1ef083e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:28.439396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d876-09cb-4d38-9f34-9b0ac1ef083e service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:28.439679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d876-09cb-4d38-9f34-9b0ac1ef083e service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:28.444812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9d876-09cb-4d38-9f34-9b0ac1ef083e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:28.449313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9d876-09cb-4d38-9f34-9b0ac1ef083e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:28.450914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9d876-09cb-4d38-9f34-9b0ac1ef083e service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:28.459467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1224/2438] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:39:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:39:28.636884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6d5a-6ed0-4876-9903-694e96d23833 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:28.647210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6d5a-6ed0-4876-9903-694e96d23833 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:28.650859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:28.651515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:28.651797 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:28.652074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:28.654721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:28.675704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:28.675704 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:28.705372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1215/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:39:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:39:29.490618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215dafd-c858-429b-aa40-9b481c09305b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:29.491126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215dafd-c858-429b-aa40-9b481c09305b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:29.491224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215dafd-c858-429b-aa40-9b481c09305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:29.510550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3215dafd-c858-429b-aa40-9b481c09305b None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:29.511845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3215dafd-c858-429b-aa40-9b481c09305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:29.521245 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1225/2440] 10.222.0.49 () {58 vars in 967 bytes} [Mon Sep 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:29.547157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:29.547157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf1fea-d306-4fd5-bfcf-471fdcf78613 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:29.553020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:29.553840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:29.554620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:29.554620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:29.563649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:29.565271 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:29.574242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1216/2441] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:39:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:39:29.953362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757205c-6159-4009-819d-258344e2fd0e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:29.954821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757205c-6159-4009-819d-258344e2fd0e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:29.955266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757205c-6159-4009-819d-258344e2fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:29.975878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1757205c-6159-4009-819d-258344e2fd0e None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:29.977094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1757205c-6159-4009-819d-258344e2fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:29.987675 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1226/2442] 10.222.0.49 () {58 vars in 967 bytes} [Mon Sep 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:30.002273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:30.022012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41e92-75bc-4cca-b6f7-bc35f3daf834 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:30.028744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:30.030070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:30.030394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:30.030617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:30.040859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:30.042439 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:30.055732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1217/2443] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:39:30.302001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346136f-675f-4c20-8f78-2fa240bff780 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:30.302885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346136f-675f-4c20-8f78-2fa240bff780 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:30.303844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346136f-675f-4c20-8f78-2fa240bff780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:30.352406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2346136f-675f-4c20-8f78-2fa240bff780 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:30.354075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2346136f-675f-4c20-8f78-2fa240bff780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:30.364324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1227/2444] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:30.380376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:30.391661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f1392-0c11-4d3d-a2eb-486fa7b4d435 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:30.397152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc41e8-9d91-4a50-a785-4203ded4de97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:30.398048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc41e8-9d91-4a50-a785-4203ded4de97 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:30.399216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc41e8-9d91-4a50-a785-4203ded4de97 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:30.399613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc41e8-9d91-4a50-a785-4203ded4de97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:30.413745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc41e8-9d91-4a50-a785-4203ded4de97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:30.415522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc41e8-9d91-4a50-a785-4203ded4de97 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:30.432127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1218/2445] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:39:30.726611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c34819-9dd1-44dc-b2de-dd460b6bd38e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:30.727284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c34819-9dd1-44dc-b2de-dd460b6bd38e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:30.727284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c34819-9dd1-44dc-b2de-dd460b6bd38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:30.748309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-61c34819-9dd1-44dc-b2de-dd460b6bd38e None None] MFA Rules not processed for user `faef1e93f5d14936b03eec5200765e35`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:30.749564 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-61c34819-9dd1-44dc-b2de-dd460b6bd38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:30.757730 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1228/2446] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:31.324407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:31.324948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:31.325095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:31.347467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:31.348775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:31.356467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1219/2447] 10.222.0.49 () {58 vars in 967 bytes} [Mon Sep 26 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:31.369981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c34819-9dd1-44dc-b2de-dd460b6bd38e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:31.384206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c34819-9dd1-44dc-b2de-dd460b6bd38e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:31.390298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10bd59-dd71-4160-a443-69c9122d1da1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:31.391755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10bd59-dd71-4160-a443-69c9122d1da1 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:31.392006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10bd59-dd71-4160-a443-69c9122d1da1 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:31.392434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10bd59-dd71-4160-a443-69c9122d1da1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:31.402541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10bd59-dd71-4160-a443-69c9122d1da1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:31.404307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10bd59-dd71-4160-a443-69c9122d1da1 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:31.413812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1229/2448] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:39:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:39:34.501427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:34.503923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:34.521297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f800e12-8932-4bbf-b1ab-93393bde591a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:34.526042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:34.526769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:34.527364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:34.527884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] PATH_INFO: `/v3/users/4154de3c530347e09203195fd6baf23a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:34.529205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4154de3c530347e09203195fd6baf23a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:34.531124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:34.746915 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4154de3c530347e09203195fd6baf23a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:34.823289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4154de3c530347e09203195fd6baf23a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:34.840240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4154de3c530347e09203195fd6baf23a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:34.841132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4154de3c530347e09203195fd6baf23a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:34.849903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4154de3c530347e09203195fd6baf23a'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:34.859765 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1220/2449] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:39:34 2022] DELETE /identity/v3/users/4154de3c530347e09203195fd6baf23a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:39:34.861650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:34.862460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:34.862739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:34.887614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:34.888992 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:34.966902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1230/2450] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:34.982997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:34.993137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:35.069908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238aea9-f90d-410a-8fbf-116bf208f0f0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:35.077164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:35.077895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:35.078243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:35.078580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:35.093944 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:35.095473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:35.108968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1221/2451] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:39:35.445612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:35.447307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:35.463477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d783d6-62be-4bc7-a106-5b84e9268e48 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:35.469428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:35.470169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:35.470521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:35.470868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] PATH_INFO: `/v3/projects/e5df5167c37f4323b152abd198cae653` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:35.472486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5df5167c37f4323b152abd198cae653)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:35.474708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:35.591193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5df5167c37f4323b152abd198cae653', 'request_id': 'req-10beca7b-5f45-4bf3-982e-0b5bef13accb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:35.658049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5df5167c37f4323b152abd198cae653', 'request_id': 'req-10beca7b-5f45-4bf3-982e-0b5bef13accb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:35.664630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5df5167c37f4323b152abd198cae653', 'request_id': 'req-10beca7b-5f45-4bf3-982e-0b5bef13accb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:35.676038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] The token cache is being invalidate because project e5df5167c37f4323b152abd198cae653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:39:35.676325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:35.677202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:39:35.678777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1231/2452] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:39:35 2022] DELETE /identity/v3/projects/e5df5167c37f4323b152abd198cae653 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:39:38.409817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:38.411335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:38.422519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:39:38.484133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d352b0-7123-45a2-80f3-41666c32d12d service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:38.550352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1def1e-a972-43cc-a22e-d62fc55c436c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:38.550969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1def1e-a972-43cc-a22e-d62fc55c436c service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:38.551276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1def1e-a972-43cc-a22e-d62fc55c436c service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:38.551542 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1def1e-a972-43cc-a22e-d62fc55c436c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:38.553325 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6a1def1e-a972-43cc-a22e-d62fc55c436c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:38.615387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1def1e-a972-43cc-a22e-d62fc55c436c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:38.618219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1def1e-a972-43cc-a22e-d62fc55c436c service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:38.629447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1222/2453] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:39:44.617700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:44.619250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:44.641003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beca7b-5f45-4bf3-982e-0b5bef13accb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:44.646742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0d48-a195-4697-b6b1-8bb30bdc5d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:44.647380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0d48-a195-4697-b6b1-8bb30bdc5d88 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:44.647668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0d48-a195-4697-b6b1-8bb30bdc5d88 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:44.647943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0d48-a195-4697-b6b1-8bb30bdc5d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:44.649689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-101b0d48-a195-4697-b6b1-8bb30bdc5d88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:44.674796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:39:44.723304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b0d48-a195-4697-b6b1-8bb30bdc5d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:44.724964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b0d48-a195-4697-b6b1-8bb30bdc5d88 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:44.735312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1232/2454] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:39:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:39:48.624694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=80 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:39:54.793357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=20 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:39:56.684722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:56.685302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:56.685302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:56.705358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] MFA Rules not processed for user `707fc75182aa430ca16da14982d5733a`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:56.707546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:56.714823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1223/2455] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:56.794968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:56.795517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:56.795618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:56.820685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:39:56.822077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:56.894290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1233/2456] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:39:56.908112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:56.910345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:56.993994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462f88-3fc2-46cb-afc3-31f7b639ec3d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:56.999510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:57.000223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:57.000510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:57.000784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:57.011728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:57.013381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:57.022446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1224/2457] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:39:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 12:39:57.527793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:39:57.531077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:57.646430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db804b-8389-4218-8e34-09119a3e5932 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:39:57.651206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1b70d-5c96-4492-8940-461a218b4b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:39:57.653684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b70d-5c96-4492-8940-461a218b4b7c service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:39:57.653684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b70d-5c96-4492-8940-461a218b4b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:39:57.653684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b70d-5c96-4492-8940-461a218b4b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:39:57.655864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-28b1b70d-5c96-4492-8940-461a218b4b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:39:57.672351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1b70d-5c96-4492-8940-461a218b4b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:39:57.674899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1b70d-5c96-4492-8940-461a218b4b7c service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:39:57.687270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1234/2458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:39:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:40:04.162020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:04.188603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae5cb0-ed05-4296-81fb-306f605118a6 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:04.203996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:04.206139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:04.206442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:04.206957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:04.211784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:04.228976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:04.232978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:04.250346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1225/2459] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:40:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:40:07.680729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=51 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:40:14.243984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=41 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:40:14.372701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:14.373176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:14.373289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:14.395726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:40:14.397121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:14.404439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1235/2460] 10.222.0.49 () {58 vars in 967 bytes} [Mon Sep 26 12:40:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:40:14.416924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:14.429070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02a7bc-5443-4e45-8c40-c86fa806be85 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:14.434345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:14.434994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:14.435263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:14.435558 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:14.445336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:14.446906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:14.456222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1226/2461] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:40:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:40:17.374802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:17.376255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:17.449969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e01e-d9e7-423e-a18f-9884f3c22054 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:17.454999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:17.455661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:17.455938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:17.456206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:17.457912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:17.469259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:17.472634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:17.482700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1236/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:40:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:40:17.506131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:17.507667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:17.582370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca796a-bca3-4029-b97d-9cb3bbfd14b8 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:17.587063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:17.589345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:17.589345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:17.589345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] PATH_INFO: `/v3/users/faef1e93f5d14936b03eec5200765e35` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:17.589622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=faef1e93f5d14936b03eec5200765e35)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:17.591419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:17.848926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faef1e93f5d14936b03eec5200765e35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:17.937028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faef1e93f5d14936b03eec5200765e35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:17.950943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faef1e93f5d14936b03eec5200765e35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:17.951822 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faef1e93f5d14936b03eec5200765e35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:17.959679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faef1e93f5d14936b03eec5200765e35'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:17.965931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1227/2463] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:40:17 2022] DELETE /identity/v3/users/faef1e93f5d14936b03eec5200765e35 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:40:18.260717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:18.274981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fcc8e-a8d7-4734-a281-f5c4672d299d service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:18.338228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:18.338871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:18.339156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:18.339465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] PATH_INFO: `/v3/projects/81d3d2ee03e946248cbb8c2caceba6a9` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:18.340623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d3d2ee03e946248cbb8c2caceba6a9)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:18.342538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:18.453315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d3d2ee03e946248cbb8c2caceba6a9', 'request_id': 'req-d974a6de-4eab-4038-9a26-7be6ed6f78f5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:18.542872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d3d2ee03e946248cbb8c2caceba6a9', 'request_id': 'req-d974a6de-4eab-4038-9a26-7be6ed6f78f5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:18.550032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d3d2ee03e946248cbb8c2caceba6a9', 'request_id': 'req-d974a6de-4eab-4038-9a26-7be6ed6f78f5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:18.561940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] The token cache is being invalidate because project 81d3d2ee03e946248cbb8c2caceba6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:40:18.562231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:18.562985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:40:18.564559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1237/2464] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:40:18 2022] DELETE /identity/v3/projects/81d3d2ee03e946248cbb8c2caceba6a9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:40:27.962312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:40:28.558663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:40:34.820517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:34.821980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:34.891469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a625640-9e75-447e-9d72-10d17b99b9dc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:34.952835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:34.953369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:34.953643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:34.953913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:34.955688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:34.968336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:34.970028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:34.980219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1228/2465] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:40:35.996195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:35.997775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:36.074554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974a6de-4eab-4038-9a26-7be6ed6f78f5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:36.080393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:36.081181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:36.081772 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:36.082052 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:36.083966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:36.097495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:36.099103 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:36.110120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1238/2466] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:40:37.835002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:37.847191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b61acc-2619-488a-8a8b-efea3208b881 service placement] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:37.852907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f7045-21ba-48fb-b982-63230b148cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:37.853502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f7045-21ba-48fb-b982-63230b148cd7 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:37.853783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f7045-21ba-48fb-b982-63230b148cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:37.854089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f7045-21ba-48fb-b982-63230b148cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:37.855838 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b6f7045-21ba-48fb-b982-63230b148cd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:37.922469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f7045-21ba-48fb-b982-63230b148cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:37.924099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f7045-21ba-48fb-b982-63230b148cd7 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:37.934130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1229/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:40:45.900882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:45.902592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:45.950313 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613951-4130-4755-b2e2-2e4913e19cc6 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:45.957560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:45.958267 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:45.958550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:45.958799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:45.960692 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:45.975043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:45.976799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:45.988258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1239/2468] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:40:47.929572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:40:53.049191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b95f-cba4-49f3-a30a-24a170633090 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:53.049843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b95f-cba4-49f3-a30a-24a170633090 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:53.049843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61b95f-cba4-49f3-a30a-24a170633090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:53.071890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-af61b95f-cba4-49f3-a30a-24a170633090 None None] MFA Rules not processed for user `442a196ea29942b682a170dc9b7ef607`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:40:53.072713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-af61b95f-cba4-49f3-a30a-24a170633090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:53.080026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1230/2469] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:40:53.438140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:40:53.439591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:53.503851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5353b3-a4fd-4af4-bc73-dff2898cc03a service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:40:53.507525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:40:53.508139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:40:53.508415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:40:53.508682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:40:53.510797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:40:53.521931 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:40:53.523397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:40:53.532985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1240/2470] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:40:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:41:03.064173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:03.528764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=77 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:23.666832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b876a-6bd9-45b6-9332-f73890793404 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:23.668333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b876a-6bd9-45b6-9332-f73890793404 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:23.668333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b876a-6bd9-45b6-9332-f73890793404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:23.695090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-708b876a-6bd9-45b6-9332-f73890793404 None None] MFA Rules not processed for user `e5496f0182f44d4d891959fe7422562c`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:23.696998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-708b876a-6bd9-45b6-9332-f73890793404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:23.764997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1231/2471] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:24.089396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:24.092970 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:24.102541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d2fc9-7ba3-425b-8387-ddc5c40cd348 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:24.106421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:24.107031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:24.107319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:24.107630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:24.109549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:24.120888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:24.122490 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:24.132048 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1241/2472] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:41:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:41:33.748783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=25 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:34.127964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:37.389582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b876a-6bd9-45b6-9332-f73890793404 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:37.399425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b876a-6bd9-45b6-9332-f73890793404 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:37.403170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:37.403875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:37.404226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:37.404592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:37.406472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:37.496494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:37.497921 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:37.518737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1232/2473] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:41:42.120126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:42.122285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:42.144200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbcfde-05c3-4a6f-93dc-311e056b58d0 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:42.150798 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:42.151794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:42.152284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:42.152781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] PATH_INFO: `/v3/users/707fc75182aa430ca16da14982d5733a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:42.154233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=707fc75182aa430ca16da14982d5733a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:42.161200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:42.443715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707fc75182aa430ca16da14982d5733a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:42.444420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707fc75182aa430ca16da14982d5733a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:42.451592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707fc75182aa430ca16da14982d5733a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:42.464544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707fc75182aa430ca16da14982d5733a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:42.554990 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0d077fda-2ee1-4be8-9c4b-3ba4ef08b1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707fc75182aa430ca16da14982d5733a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:42.561650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1242/2474] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:41:42 2022] DELETE /identity/v3/users/707fc75182aa430ca16da14982d5733a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:41:42.821102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:42.832671 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3806-2227-4b73-af21-53d84342f124 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:42.905362 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:42.906035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:42.907166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:42.908171 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] PATH_INFO: `/v3/projects/576ee35ecff64e7dadf3c174b0a6f348` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:42.910317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576ee35ecff64e7dadf3c174b0a6f348)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:42.911552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:43.052887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576ee35ecff64e7dadf3c174b0a6f348', 'request_id': 'req-30e6fd54-f1ba-4e5c-9796-e392fc43d021'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:43.160453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576ee35ecff64e7dadf3c174b0a6f348', 'request_id': 'req-30e6fd54-f1ba-4e5c-9796-e392fc43d021'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:43.166999 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576ee35ecff64e7dadf3c174b0a6f348', 'request_id': 'req-30e6fd54-f1ba-4e5c-9796-e392fc43d021'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:43.169001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:43.178903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] The token cache is being invalidate because project 576ee35ecff64e7dadf3c174b0a6f348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:41:43.179217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:43.179883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-30e6fd54-f1ba-4e5c-9796-e392fc43d021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:43.181378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1233/2475] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:41:42 2022] DELETE /identity/v3/projects/576ee35ecff64e7dadf3c174b0a6f348 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:41:43.186310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df1f3-8afd-4781-b674-108afe01f759 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.186815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df1f3-8afd-4781-b674-108afe01f759 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.186941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df1f3-8afd-4781-b674-108afe01f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.207924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b55df1f3-8afd-4781-b674-108afe01f759 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:43.209123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b55df1f3-8afd-4781-b674-108afe01f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:43.393463 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1243/2476] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:43.401054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24264e-3704-4e26-ba5e-795cd367e7a6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.401342 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24264e-3704-4e26-ba5e-795cd367e7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.401650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24264e-3704-4e26-ba5e-795cd367e7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.421833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4a24264e-3704-4e26-ba5e-795cd367e7a6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:43.423046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4a24264e-3704-4e26-ba5e-795cd367e7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:43.431029 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1234/2477] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:43.435350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df1f3-8afd-4781-b674-108afe01f759 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:43.445127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df1f3-8afd-4781-b674-108afe01f759 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:43.449572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:43.450168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.450444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.450711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.451382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:41:43.451684 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:43.453252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:43.465512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1244/2478] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:41:43.469808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24264e-3704-4e26-ba5e-795cd367e7a6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:43.480108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24264e-3704-4e26-ba5e-795cd367e7a6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:43.484785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:43.485379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.485658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.485931 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.486694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:43.488630 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:43.619672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1235/2479] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:41:43 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:41:43.623974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:43.634922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149d24-7a5b-4466-a553-f6579f23ee98 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:43.692389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:43.692890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.693163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.693477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.694187 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:43.696210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:43.704340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:43.823533 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1245/2480] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:41:43 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:41:43.827962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:43.839060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950c99d-d9d3-4bad-9af8-ec96b6eec302 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:43.843679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:43.844284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.844563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.844833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.845556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:43.847195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:43.857304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1236/2481] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:41:43.861467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:43.871531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008d0e-a3b4-420f-8b20-048588adfbab admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:43.876206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b84a9d-8a6d-4cf8-ab21-abd9e7a0a9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:43.877450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84a9d-8a6d-4cf8-ab21-abd9e7a0a9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.877830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84a9d-8a6d-4cf8-ab21-abd9e7a0a9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.878104 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b84a9d-8a6d-4cf8-ab21-abd9e7a0a9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.878749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b84a9d-8a6d-4cf8-ab21-abd9e7a0a9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:43.880366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b84a9d-8a6d-4cf8-ab21-abd9e7a0a9ca admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:43.891042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1246/2482] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:41:43.895775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:43.906139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc514cb3-c634-4d14-9ab7-54101e8786b3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:43.910756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:43.911435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:43.911720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:43.911994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] PATH_INFO: `/v3/projects/6bb3e945830e453297aefd70fda1a29b/users/3e8c589fab4f4b12b5b8f1516370408f/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:43.927388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb3e945830e453297aefd70fda1a29b, user_id=3e8c589fab4f4b12b5b8f1516370408f, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:43.930039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:44.007436 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1237/2483] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:41:43 2022] PUT /identity/v3/projects/6bb3e945830e453297aefd70fda1a29b/users/3e8c589fab4f4b12b5b8f1516370408f/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:41:44.019028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603232d0-07fc-474f-9f69-ab4da2027ca1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:44.024060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603232d0-07fc-474f-9f69-ab4da2027ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:44.024060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603232d0-07fc-474f-9f69-ab4da2027ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:44.046958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-603232d0-07fc-474f-9f69-ab4da2027ca1 None None] MFA Rules not processed for user `3e8c589fab4f4b12b5b8f1516370408f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:44.048210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-603232d0-07fc-474f-9f69-ab4da2027ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:44.122053 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1247/2484] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:44.134511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:44.136598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:44.215223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ad347-eb93-4190-b3a3-69fcac0a46e9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:44.220940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6938cc-13d6-4274-a2a5-c296a157d45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:44.221627 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6938cc-13d6-4274-a2a5-c296a157d45b service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:44.221904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6938cc-13d6-4274-a2a5-c296a157d45b service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:44.222166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6938cc-13d6-4274-a2a5-c296a157d45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:44.231162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6938cc-13d6-4274-a2a5-c296a157d45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:44.232766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6938cc-13d6-4274-a2a5-c296a157d45b service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:44.242111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1238/2485] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:41:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:41:51.696743 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603232d0-07fc-474f-9f69-ab4da2027ca1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:51.754520 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603232d0-07fc-474f-9f69-ab4da2027ca1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:51.759059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:51.759704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:51.759979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:51.760502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] PATH_INFO: `/v3/users/3e8c589fab4f4b12b5b8f1516370408f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:51.761611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8c589fab4f4b12b5b8f1516370408f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:51.763526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:51.988137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8c589fab4f4b12b5b8f1516370408f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:51.988807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8c589fab4f4b12b5b8f1516370408f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:51.995889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8c589fab4f4b12b5b8f1516370408f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:52.006767 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:52.009155 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8c589fab4f4b12b5b8f1516370408f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:52.063126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8c589fab4f4b12b5b8f1516370408f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:52.069918 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1248/2486] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:41:51 2022] DELETE /identity/v3/users/3e8c589fab4f4b12b5b8f1516370408f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:41:52.074460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:52.074857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:52.075011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:52.094990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:52.097251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:52.157469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1239/2487] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:41:52.185846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:52.185846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:52.230404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373289e-1163-4f0b-b5b4-bd7383223d16 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:52.234154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935718d8-2e96-4a73-b5f8-c6a9ebda36eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:52.234757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935718d8-2e96-4a73-b5f8-c6a9ebda36eb service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:52.235034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935718d8-2e96-4a73-b5f8-c6a9ebda36eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:52.235303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935718d8-2e96-4a73-b5f8-c6a9ebda36eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:52.245539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935718d8-2e96-4a73-b5f8-c6a9ebda36eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:52.246958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935718d8-2e96-4a73-b5f8-c6a9ebda36eb service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:52.256778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1249/2488] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:41:52.849632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:52.851192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:52.863919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb095cb-a46a-49aa-9429-c80fe1a55f47 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:52.868665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:52.869309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:52.869587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:52.869879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] PATH_INFO: `/v3/projects/6bb3e945830e453297aefd70fda1a29b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:52.871033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb3e945830e453297aefd70fda1a29b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:52.872990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:52.887788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:53.032287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb3e945830e453297aefd70fda1a29b', 'request_id': 'req-55822c80-8b9f-4109-9832-bea26b907950'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:53.129078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb3e945830e453297aefd70fda1a29b', 'request_id': 'req-55822c80-8b9f-4109-9832-bea26b907950'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:53.135570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb3e945830e453297aefd70fda1a29b', 'request_id': 'req-55822c80-8b9f-4109-9832-bea26b907950'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:53.147522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] The token cache is being invalidate because project 6bb3e945830e453297aefd70fda1a29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:41:53.147826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:53.148460 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-55822c80-8b9f-4109-9832-bea26b907950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:41:53.149959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1240/2489] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:41:52 2022] DELETE /identity/v3/projects/6bb3e945830e453297aefd70fda1a29b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:41:53.154752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929fdc0-042b-4bb9-b570-d084b157cd46 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.155312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929fdc0-042b-4bb9-b570-d084b157cd46 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.155312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929fdc0-042b-4bb9-b570-d084b157cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.175289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e929fdc0-042b-4bb9-b570-d084b157cd46 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:53.176596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e929fdc0-042b-4bb9-b570-d084b157cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:53.236188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1250/2490] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:53.245526 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6472e0-fdb0-4686-b3a1-68134e6771ad None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.245809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6472e0-fdb0-4686-b3a1-68134e6771ad None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.246100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6472e0-fdb0-4686-b3a1-68134e6771ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.268195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-df6472e0-fdb0-4686-b3a1-68134e6771ad None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:53.269389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-df6472e0-fdb0-4686-b3a1-68134e6771ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:53.277213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1241/2491] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:53.281650 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929fdc0-042b-4bb9-b570-d084b157cd46 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:53.291611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929fdc0-042b-4bb9-b570-d084b157cd46 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:53.296240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:53.296834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.297116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.297386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.298032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:41:53.298873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:53.300614 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:53.312122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1251/2492] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:41:53.317009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6472e0-fdb0-4686-b3a1-68134e6771ad None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:53.326188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6472e0-fdb0-4686-b3a1-68134e6771ad None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:53.330853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:53.331476 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.331750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.332022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.332631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:53.334505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:53.425043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1242/2493] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:41:53 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:41:53.429377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:53.440062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c5447-1a89-4f1f-b173-875d73accf05 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:53.496942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:53.497541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.497825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.498085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.498723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:53.500663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:53.632126 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1252/2494] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:41:53 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:41:53.636643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:53.647357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791aff-91e3-4d89-af79-801b007cc354 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:53.651968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:53.652561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.652840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.653106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.653743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:53.655328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:53.666950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1243/2495] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:41:53.671428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:53.682559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f639689-082b-4064-b602-7d36b9cc24e2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:53.687075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b064b4-c839-4e38-bbc6-1589b3d034f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:53.687736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b064b4-c839-4e38-bbc6-1589b3d034f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.688017 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b064b4-c839-4e38-bbc6-1589b3d034f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.688281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b064b4-c839-4e38-bbc6-1589b3d034f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.688941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b064b4-c839-4e38-bbc6-1589b3d034f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:53.690502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b064b4-c839-4e38-bbc6-1589b3d034f9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:53.691776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:53.701623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1253/2496] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:41:53.711071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:53.721254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de0b9c-f4ff-45f9-81c7-297a15cdd63b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:53.725899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:53.726551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.726828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.727101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] PATH_INFO: `/v3/projects/726228712509448c98d6a95a20ac8d82/users/9dfebbb95b854f78afb3320ccc5d7650/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.743489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=726228712509448c98d6a95a20ac8d82, user_id=9dfebbb95b854f78afb3320ccc5d7650, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:53.746205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:53.829482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1244/2497] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:41:53 2022] PUT /identity/v3/projects/726228712509448c98d6a95a20ac8d82/users/9dfebbb95b854f78afb3320ccc5d7650/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:41:53.840181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabeb26-049b-4ec2-9c2e-79bcade94bf2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:53.840460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabeb26-049b-4ec2-9c2e-79bcade94bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:53.840752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabeb26-049b-4ec2-9c2e-79bcade94bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:53.869603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-afabeb26-049b-4ec2-9c2e-79bcade94bf2 None None] MFA Rules not processed for user `9dfebbb95b854f78afb3320ccc5d7650`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:53.870823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afabeb26-049b-4ec2-9c2e-79bcade94bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:53.946012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1254/2498] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:41:53.950650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:54.016767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f441a07-1b38-4514-ada7-bfc70740b36d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:54.022192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:54.022794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.023071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.023353 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.024041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:54.025941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:54.134078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1245/2499] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:41:53 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:41:54.138460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabeb26-049b-4ec2-9c2e-79bcade94bf2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:54.151145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabeb26-049b-4ec2-9c2e-79bcade94bf2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:54.208862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:54.209508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.209647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.209921 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.210570 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:54.212527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:54.326265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1255/2500] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:41:54 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:41:54.331095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:54.341494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e791ff6-9080-4a4d-ba76-91e845da5deb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:54.346229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:54.346833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.347118 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.347424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.348071 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:54.349667 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:54.360138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1246/2501] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:41:54.364757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:54.374834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5646c-b44a-41df-b185-2937689e7939 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:54.380200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:54.380851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.381132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.381405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] PATH_INFO: `/v3/projects/5b8b7cea76804fff8dffa4c6fa687577/users/d840ac1a8b924ac089876b34d2b527fa/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.396948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8b7cea76804fff8dffa4c6fa687577, user_id=d840ac1a8b924ac089876b34d2b527fa, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:54.399611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:54.465729 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1256/2502] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:41:54 2022] PUT /identity/v3/projects/5b8b7cea76804fff8dffa4c6fa687577/users/d840ac1a8b924ac089876b34d2b527fa/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:41:54.469780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:54.479981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478c29-f20b-46a2-bfb3-6aa21f6b6e6c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:54.489003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:54.540142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8028-5807-4608-82e8-01a676c2a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:54.541344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8028-5807-4608-82e8-01a676c2a85d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.541626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8028-5807-4608-82e8-01a676c2a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.541895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8028-5807-4608-82e8-01a676c2a85d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.542635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b8028-5807-4608-82e8-01a676c2a85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:54.544372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b8028-5807-4608-82e8-01a676c2a85d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:54.558494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1247/2503] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:41:54.559701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:54.571073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca255d-293b-45d6-9417-a51d31a82b91 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:54.575829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:54.576479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.576752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.577056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] PATH_INFO: `/v3/projects/5b8b7cea76804fff8dffa4c6fa687577/users/d840ac1a8b924ac089876b34d2b527fa/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.579087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8b7cea76804fff8dffa4c6fa687577, user_id=d840ac1a8b924ac089876b34d2b527fa, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:54.581905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:54.592455 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1257/2504] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:41:54 2022] PUT /identity/v3/projects/5b8b7cea76804fff8dffa4c6fa687577/users/d840ac1a8b924ac089876b34d2b527fa/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:41:54.604207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8693a37-125d-475e-b471-3694a825ea6c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.604500 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8693a37-125d-475e-b471-3694a825ea6c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.604780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8693a37-125d-475e-b471-3694a825ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.635925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c8693a37-125d-475e-b471-3694a825ea6c None None] MFA Rules not processed for user `d840ac1a8b924ac089876b34d2b527fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:54.637182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c8693a37-125d-475e-b471-3694a825ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:54.708946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1248/2505] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:54.721049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:54.722728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:54.763978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:54.780399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b489f-2c29-4d4c-8844-39ec3afbf6b8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:54.785285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96e06e-7b13-4d18-9a39-d976aa0001e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:54.785901 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e06e-7b13-4d18-9a39-d976aa0001e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:54.786184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e06e-7b13-4d18-9a39-d976aa0001e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:54.786457 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96e06e-7b13-4d18-9a39-d976aa0001e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:54.796669 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96e06e-7b13-4d18-9a39-d976aa0001e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:54.798139 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96e06e-7b13-4d18-9a39-d976aa0001e2 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:54.808347 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1258/2506] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:41:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:41:55.038327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8693a37-125d-475e-b471-3694a825ea6c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:55.048041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8693a37-125d-475e-b471-3694a825ea6c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:55.051673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:55.052296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:55.052563 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:55.052835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:55.111270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:55.114092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:55.122021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1249/2507] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:41:57.679593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30212ab-900d-4ec3-bc16-d4bda518a25f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:57.680246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30212ab-900d-4ec3-bc16-d4bda518a25f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:57.680246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30212ab-900d-4ec3-bc16-d4bda518a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:57.700088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c30212ab-900d-4ec3-bc16-d4bda518a25f None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:41:57.701372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c30212ab-900d-4ec3-bc16-d4bda518a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:57.773930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1259/2508] 10.222.0.49 () {58 vars in 967 bytes} [Mon Sep 26 12:41:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:41:57.976577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:41:57.978007 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:41:58.014237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:41:58.052278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c7e1f-95f1-4fb2-b52e-03956f763d06 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:41:58.057513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c75c7-e09c-487f-bd8a-28e05f37e7d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:41:58.066423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c75c7-e09c-487f-bd8a-28e05f37e7d2 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:41:58.066423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c75c7-e09c-487f-bd8a-28e05f37e7d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:41:58.066423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c75c7-e09c-487f-bd8a-28e05f37e7d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:41:58.068301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c75c7-e09c-487f-bd8a-28e05f37e7d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:41:58.069975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c75c7-e09c-487f-bd8a-28e05f37e7d2 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:41:58.078826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1250/2509] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:42:04.294560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30212ab-900d-4ec3-bc16-d4bda518a25f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:04.368568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30212ab-900d-4ec3-bc16-d4bda518a25f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:04.373422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:04.374066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:04.374350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:04.374634 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] PATH_INFO: `/v3/users/9dfebbb95b854f78afb3320ccc5d7650` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:04.375907 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfebbb95b854f78afb3320ccc5d7650)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:04.378852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:04.576828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfebbb95b854f78afb3320ccc5d7650'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:04.577504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfebbb95b854f78afb3320ccc5d7650'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:04.585429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfebbb95b854f78afb3320ccc5d7650'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:04.600180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfebbb95b854f78afb3320ccc5d7650'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:04.680279 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfebbb95b854f78afb3320ccc5d7650'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:04.686682 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1260/2510] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:04 2022] DELETE /identity/v3/users/9dfebbb95b854f78afb3320ccc5d7650 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:04.691335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:04.691966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:04.691966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:04.711081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:04.712396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:04.774888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1251/2511] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:04.785999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:04.788343 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:04.795254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:04.861038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeedb77-b234-47c6-9f25-0645159487bc admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:04.866959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:04.869174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:04.869402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:04.869670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:04.880630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:04.883425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:04.895078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1261/2512] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:05.907629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:05.909157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:05.921318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86728784-fe4d-4a2b-9778-4d81ff45b365 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:05.926700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:05.927375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:05.927658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:05.928250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] PATH_INFO: `/v3/projects/726228712509448c98d6a95a20ac8d82` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:05.929420 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726228712509448c98d6a95a20ac8d82)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:05.931336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:06.085407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726228712509448c98d6a95a20ac8d82', 'request_id': 'req-7ad2694b-13c5-4605-b445-7549bab6d122'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.183428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726228712509448c98d6a95a20ac8d82', 'request_id': 'req-7ad2694b-13c5-4605-b445-7549bab6d122'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.190869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726228712509448c98d6a95a20ac8d82', 'request_id': 'req-7ad2694b-13c5-4605-b445-7549bab6d122'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.203803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] The token cache is being invalidate because project 726228712509448c98d6a95a20ac8d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:06.204205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.204949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.206668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1252/2513] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:05 2022] DELETE /identity/v3/projects/726228712509448c98d6a95a20ac8d82 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:06.210668 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:06.221467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04774774-b045-403e-a4ab-87b133fcc426 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:06.283897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:06.284543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:06.284799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:06.285070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] PATH_INFO: `/v3/users/d840ac1a8b924ac089876b34d2b527fa` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:06.286203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d840ac1a8b924ac089876b34d2b527fa)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:06.288134 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:06.484168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd840ac1a8b924ac089876b34d2b527fa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.484892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd840ac1a8b924ac089876b34d2b527fa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.492600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd840ac1a8b924ac089876b34d2b527fa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.505582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd840ac1a8b924ac089876b34d2b527fa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.611532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c0dea235-787c-4707-b7be-54dc8cfe2ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd840ac1a8b924ac089876b34d2b527fa'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:06.618244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1262/2514] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:06 2022] DELETE /identity/v3/users/d840ac1a8b924ac089876b34d2b527fa => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:07.236559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:07.238953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:07.255970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2694b-13c5-4605-b445-7549bab6d122 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:07.314684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:07.332132 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:07.332983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:07.333333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:07.333681 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] PATH_INFO: `/v3/projects/5b8b7cea76804fff8dffa4c6fa687577` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:07.334964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8b7cea76804fff8dffa4c6fa687577)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:07.337144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:07.492100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8b7cea76804fff8dffa4c6fa687577', 'request_id': 'req-dccc5637-a6a8-4481-8a12-2a4b8b15953e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:07.617230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8b7cea76804fff8dffa4c6fa687577', 'request_id': 'req-dccc5637-a6a8-4481-8a12-2a4b8b15953e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:07.623359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8b7cea76804fff8dffa4c6fa687577', 'request_id': 'req-dccc5637-a6a8-4481-8a12-2a4b8b15953e'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:07.635566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] The token cache is being invalidate because project 5b8b7cea76804fff8dffa4c6fa687577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:07.635918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:07.636528 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dccc5637-a6a8-4481-8a12-2a4b8b15953e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:07.638014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1253/2515] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:07 2022] DELETE /identity/v3/projects/5b8b7cea76804fff8dffa4c6fa687577 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:07.643454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:07.643974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:07.643974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:07.664755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:07.666096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:07.687216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:07.728502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1263/2516] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:07.739742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444a118-2226-456c-a8c4-4f52aa74e969 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:07.740034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444a118-2226-456c-a8c4-4f52aa74e969 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:07.740396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444a118-2226-456c-a8c4-4f52aa74e969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:07.740784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:07.742442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:07.757196 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327c3ff-e7fb-4ae7-b463-75422aec8ca0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:07.762766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:07.763361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:07.763648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:07.763916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] PATH_INFO: `/v3/users/41b6d5cebad24fe2a1f7436b77f91b6f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:07.764127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8444a118-2226-456c-a8c4-4f52aa74e969 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:07.765058 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b6d5cebad24fe2a1f7436b77f91b6f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:07.765344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8444a118-2226-456c-a8c4-4f52aa74e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:07.767120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:07.774853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1254/2517] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:42:07.779157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444a118-2226-456c-a8c4-4f52aa74e969 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:07.788537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444a118-2226-456c-a8c4-4f52aa74e969 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:07.793587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:07.794195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:07.794480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:07.794746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:07.795988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:42:07.796474 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:07.803719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:07.817450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1255/2518] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:42:07.821988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:07.833208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc220a75-9e2e-414e-a67a-7c305d9ebf46 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:07.838094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:07.838766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:07.839122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:07.839437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:07.840469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:07.842033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:07.967320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1256/2519] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:42:07 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:42:07.972075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.036293 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5816f-18c8-49b1-a5ae-c4a548520ec1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.041070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.041680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.041963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.042234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.042867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.044898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.055810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b6d5cebad24fe2a1f7436b77f91b6f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.056714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b6d5cebad24fe2a1f7436b77f91b6f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.064789 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b6d5cebad24fe2a1f7436b77f91b6f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.078012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b6d5cebad24fe2a1f7436b77f91b6f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.158020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1257/2520] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:42:07 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:42:08.162092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.163059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b6d5cebad24fe2a1f7436b77f91b6f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.163908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:08.170382 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1264/2521] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:07 2022] DELETE /identity/v3/users/41b6d5cebad24fe2a1f7436b77f91b6f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:08.178215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb9103-4b9a-417a-a7a1-062677f3320e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.200449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:08.249588 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.250304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.250475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.252135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.252854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.254462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.265983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1258/2522] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:42:08.270067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.280439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd8d63-ec2c-4d89-8dbe-1bb01801c248 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.285432 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67157ace-43b7-4be6-9cbd-93806715be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.286055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67157ace-43b7-4be6-9cbd-93806715be49 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.286392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67157ace-43b7-4be6-9cbd-93806715be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.286629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67157ace-43b7-4be6-9cbd-93806715be49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.287247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67157ace-43b7-4be6-9cbd-93806715be49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.288894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67157ace-43b7-4be6-9cbd-93806715be49 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.300521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1265/2523] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:08.304989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.315907 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8d70a-b06c-44a7-a350-a9924fd27f29 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.320749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.321419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.321703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.321980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] PATH_INFO: `/v3/projects/5c9c0a9db98944cd9ddd92b439359eb7/users/2f72dade1e844bbdbcf6295400b87430/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.337484 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9c0a9db98944cd9ddd92b439359eb7, user_id=2f72dade1e844bbdbcf6295400b87430, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.340375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.440696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1259/2524] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:08 2022] PUT /identity/v3/projects/5c9c0a9db98944cd9ddd92b439359eb7/users/2f72dade1e844bbdbcf6295400b87430/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:08.452388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b616f-2a4e-4595-9d5b-fc1d69ef4aff None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.452969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b616f-2a4e-4595-9d5b-fc1d69ef4aff None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.453260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b616f-2a4e-4595-9d5b-fc1d69ef4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.479024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.480800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:08.490226 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d73b616f-2a4e-4595-9d5b-fc1d69ef4aff None None] MFA Rules not processed for user `2f72dade1e844bbdbcf6295400b87430`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:08.490738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d73b616f-2a4e-4595-9d5b-fc1d69ef4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:08.563500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1266/2525] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:08.566727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479191d-bce9-4974-bdfd-bbd5c7a28bca admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.567914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b616f-2a4e-4595-9d5b-fc1d69ef4aff None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.571855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.575043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.575043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.575043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] PATH_INFO: `/v3/projects/1e90498000b5488b84e9bbd967b6afe1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.575043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e90498000b5488b84e9bbd967b6afe1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.575971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.579674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b616f-2a4e-4595-9d5b-fc1d69ef4aff None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.591908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.592599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.593045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.593249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.593952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.596463 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.613632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:08.731912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e90498000b5488b84e9bbd967b6afe1', 'request_id': 'req-b5e7284b-dc87-497f-b52b-f38a088bac7d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.792201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1267/2526] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:42:08 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:42:08.796030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.811892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e90498000b5488b84e9bbd967b6afe1', 'request_id': 'req-b5e7284b-dc87-497f-b52b-f38a088bac7d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.820100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e90498000b5488b84e9bbd967b6afe1', 'request_id': 'req-b5e7284b-dc87-497f-b52b-f38a088bac7d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.830481 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] The token cache is being invalidate because project 1e90498000b5488b84e9bbd967b6afe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:08.830760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.831449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:08.832964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1260/2527] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:08 2022] DELETE /identity/v3/projects/1e90498000b5488b84e9bbd967b6afe1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:08.837300 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.838735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:08.865778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc2e33-3c84-44c7-8a5d-ff83b9505d5d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.873714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:08.881081 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.881759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.882036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.885542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.885542 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.885720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.917682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7284b-dc87-497f-b52b-f38a088bac7d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:08.920949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:08.921670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:08.921954 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:08.922232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] PATH_INFO: `/v3/users/bb1622989eb74d9da7b2d965da3209b6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:08.923833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1622989eb74d9da7b2d965da3209b6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:08.925813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:08.986090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1268/2528] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:42:08 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:08.992508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:08.996116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:09.014759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54682a-7397-4def-ae6c-1b9d7d951a61 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:09.020554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:09.021170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:09.021451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:09.021722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:09.022395 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:09.026188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:09.037672 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1269/2529] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:42:09.042753 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:09.053942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9153a80-52c8-470d-b98c-cbdc3e02f6dd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:09.058837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:09.059568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:09.059850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:09.060127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] PATH_INFO: `/v3/projects/6d33c10849454141b21da495a4a6a716/users/2eea3558763047278fdc4c607f2ebd0f/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:09.078277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d33c10849454141b21da495a4a6a716, user_id=2eea3558763047278fdc4c607f2ebd0f, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:09.082124 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:09.152649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1622989eb74d9da7b2d965da3209b6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.177594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1270/2530] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:09 2022] PUT /identity/v3/projects/6d33c10849454141b21da495a4a6a716/users/2eea3558763047278fdc4c607f2ebd0f/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:09.181868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:09.231084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1622989eb74d9da7b2d965da3209b6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.247042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1622989eb74d9da7b2d965da3209b6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.247825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1622989eb74d9da7b2d965da3209b6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.251673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b907097-6164-4d12-a912-8e3f4d3cbc78 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:09.257083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1622989eb74d9da7b2d965da3209b6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.258283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb275fa8-a425-402c-9984-9a532708d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:09.259252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275fa8-a425-402c-9984-9a532708d506 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:09.259769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275fa8-a425-402c-9984-9a532708d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:09.260500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb275fa8-a425-402c-9984-9a532708d506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:09.261697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb275fa8-a425-402c-9984-9a532708d506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:09.264541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb275fa8-a425-402c-9984-9a532708d506 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:09.268925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1261/2531] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:08 2022] DELETE /identity/v3/users/bb1622989eb74d9da7b2d965da3209b6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:09.278215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1271/2532] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:42:09.284198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:09.285724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:09.359709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0b27c-6640-4c5c-9668-6d25db643bad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:09.364641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:09.365333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:09.365615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:09.365889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] PATH_INFO: `/v3/projects/6d33c10849454141b21da495a4a6a716/users/2eea3558763047278fdc4c607f2ebd0f/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:09.367912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d33c10849454141b21da495a4a6a716, user_id=2eea3558763047278fdc4c607f2ebd0f, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:09.370555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:09.382737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1262/2533] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:09 2022] PUT /identity/v3/projects/6d33c10849454141b21da495a4a6a716/users/2eea3558763047278fdc4c607f2ebd0f/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:09.394149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:09.394441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:09.394721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:09.427773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] MFA Rules not processed for user `2eea3558763047278fdc4c607f2ebd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:09.429141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:09.470867 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:09.509405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1272/2534] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:09.522595 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:09.524385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:09.571071 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:09.572709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:09.575189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:09.595244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d996c2-80b6-4705-8d1b-5b8e8afaa3d4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:09.599196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:09.599861 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:09.600139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:09.600411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:09.602393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:09.648111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb6364-7ada-4f71-ac17-9500050bf2c5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:09.653024 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:09.653906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:09.654202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:09.654504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] PATH_INFO: `/v3/projects/444640122e0c42c994bfc892c19fdb7b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:09.655894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444640122e0c42c994bfc892c19fdb7b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:09.657873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:09.670995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:09.673261 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:09.683260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1263/2535] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:09.783302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444640122e0c42c994bfc892c19fdb7b', 'request_id': 'req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.848713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444640122e0c42c994bfc892c19fdb7b', 'request_id': 'req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.855396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444640122e0c42c994bfc892c19fdb7b', 'request_id': 'req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.868424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] The token cache is being invalidate because project 444640122e0c42c994bfc892c19fdb7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:09.868718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.869403 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:09.870914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1273/2536] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:09 2022] DELETE /identity/v3/projects/444640122e0c42c994bfc892c19fdb7b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:12.534684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:12.543299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cf4b2-9f3d-4fa3-a846-d6e4a67eaa87 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:12.592399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558194f0-5a9c-4e33-bfdd-5115e9f51ae0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:12.599575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558194f0-5a9c-4e33-bfdd-5115e9f51ae0 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:12.599575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558194f0-5a9c-4e33-bfdd-5115e9f51ae0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:12.599575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558194f0-5a9c-4e33-bfdd-5115e9f51ae0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:12.599575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-558194f0-5a9c-4e33-bfdd-5115e9f51ae0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:12.660338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558194f0-5a9c-4e33-bfdd-5115e9f51ae0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:12.661769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558194f0-5a9c-4e33-bfdd-5115e9f51ae0 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:12.671446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1264/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:18.055716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:18.057304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:18.122551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:18.134590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c7b5c-9eab-4ebc-b673-499c6a070b80 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:18.139443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:18.140067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:18.140400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:18.140840 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] PATH_INFO: `/v3/users/2f72dade1e844bbdbcf6295400b87430` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:18.141962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f72dade1e844bbdbcf6295400b87430)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:18.143896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:18.414541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f72dade1e844bbdbcf6295400b87430'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:18.415249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f72dade1e844bbdbcf6295400b87430'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:18.423167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f72dade1e844bbdbcf6295400b87430'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:18.435818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f72dade1e844bbdbcf6295400b87430'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:18.580199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f72dade1e844bbdbcf6295400b87430'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:18.586942 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1274/2538] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:18 2022] DELETE /identity/v3/users/2f72dade1e844bbdbcf6295400b87430 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:18.591891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:18.592393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:18.592578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:18.623206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:18.624499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:18.656088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:18.686257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1265/2539] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:18.696574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:18.698208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:18.775592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22151f-cadf-4ec8-8ef6-256d4ca3df71 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:18.779199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:18.779852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:18.780127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:18.780392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:18.794572 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:18.796555 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:18.808242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1275/2540] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:19.504384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:19.505842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:19.519374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ce374-b921-41e3-bb33-eb39626915bd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:19.524257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:19.524903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:19.525182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:19.525453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] PATH_INFO: `/v3/projects/5c9c0a9db98944cd9ddd92b439359eb7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:19.527151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9c0a9db98944cd9ddd92b439359eb7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:19.535274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:19.631770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9c0a9db98944cd9ddd92b439359eb7', 'request_id': 'req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:19.839611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9c0a9db98944cd9ddd92b439359eb7', 'request_id': 'req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:19.846975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9c0a9db98944cd9ddd92b439359eb7', 'request_id': 'req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:19.858920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] The token cache is being invalidate because project 5c9c0a9db98944cd9ddd92b439359eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:19.859228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:19.860584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:19.862225 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1266/2541] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:19 2022] DELETE /identity/v3/projects/5c9c0a9db98944cd9ddd92b439359eb7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:19.866374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:19.877414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15697c-1f00-46db-aeb4-3b9dce606028 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:19.936028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:19.936654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:19.936934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:19.937205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] PATH_INFO: `/v3/users/2eea3558763047278fdc4c607f2ebd0f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:19.938709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eea3558763047278fdc4c607f2ebd0f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:19.940671 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:19.942214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:20.223307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eea3558763047278fdc4c607f2ebd0f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:20.224005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eea3558763047278fdc4c607f2ebd0f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:20.231809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eea3558763047278fdc4c607f2ebd0f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:20.244603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eea3558763047278fdc4c607f2ebd0f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:20.348217 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-51d58c4f-2a49-40a6-b274-902cf0080563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eea3558763047278fdc4c607f2ebd0f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:20.354654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1276/2542] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:19 2022] DELETE /identity/v3/users/2eea3558763047278fdc4c607f2ebd0f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:20.816142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:20.817739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:20.830760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad28c3d-6a2c-4ec0-a926-a8e9b54e7383 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:20.895291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:20.903055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:20.903055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:20.903055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] PATH_INFO: `/v3/projects/6d33c10849454141b21da495a4a6a716` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:20.903055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d33c10849454141b21da495a4a6a716)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:20.903055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:21.006161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d33c10849454141b21da495a4a6a716', 'request_id': 'req-77c94a7e-65a1-4f00-8c27-41297795dbd7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:21.088586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d33c10849454141b21da495a4a6a716', 'request_id': 'req-77c94a7e-65a1-4f00-8c27-41297795dbd7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:21.093671 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:21.096799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d33c10849454141b21da495a4a6a716', 'request_id': 'req-77c94a7e-65a1-4f00-8c27-41297795dbd7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:21.109138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] The token cache is being invalidate because project 6d33c10849454141b21da495a4a6a716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:21.109430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:21.110798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-77c94a7e-65a1-4f00-8c27-41297795dbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:21.112421 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1267/2543] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:20 2022] DELETE /identity/v3/projects/6d33c10849454141b21da495a4a6a716 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:21.118303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925ff5-b5e6-456b-b34c-bad525522159 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.118911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925ff5-b5e6-456b-b34c-bad525522159 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.119565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925ff5-b5e6-456b-b34c-bad525522159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.170557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cb925ff5-b5e6-456b-b34c-bad525522159 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:21.171815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cb925ff5-b5e6-456b-b34c-bad525522159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:21.230216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1277/2544] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:21.238796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655339-f2c7-4d1f-a49f-05cf2035a637 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.239085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655339-f2c7-4d1f-a49f-05cf2035a637 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.239383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655339-f2c7-4d1f-a49f-05cf2035a637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.262525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-39655339-f2c7-4d1f-a49f-05cf2035a637 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:21.263805 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-39655339-f2c7-4d1f-a49f-05cf2035a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:21.272222 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1268/2545] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:21.276695 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925ff5-b5e6-456b-b34c-bad525522159 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:21.287551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925ff5-b5e6-456b-b34c-bad525522159 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:21.292195 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:21.292793 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.293073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.293350 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.293998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:42:21.294298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:21.295932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:21.308437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1278/2546] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:42:21.313130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39655339-f2c7-4d1f-a49f-05cf2035a637 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:21.323368 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39655339-f2c7-4d1f-a49f-05cf2035a637 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:21.328281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:21.335652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.335652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.335652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.335652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:21.335652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:21.430430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1269/2547] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:42:21 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:21.434673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:21.444806 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea71c-38a5-4a66-917d-84ab1a996f6f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:21.486035 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:21.502003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:21.505354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.505354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.505354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.505354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:21.505816 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:21.604693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1279/2548] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:42:21 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:42:21.608919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:21.619435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01797167-379a-4e63-a77b-fc444a15bba3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:21.624139 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:21.624732 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.625004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.625269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.626070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:21.627696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:21.638176 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1270/2549] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:21.645819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:21.655834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9b79-0dc3-46dc-b7ae-d1ded84260f2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:21.661105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4051a5b-e8de-4d87-b821-f3cbb68f73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:21.661696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4051a5b-e8de-4d87-b821-f3cbb68f73ef admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.661974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4051a5b-e8de-4d87-b821-f3cbb68f73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.662250 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4051a5b-e8de-4d87-b821-f3cbb68f73ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.662885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4051a5b-e8de-4d87-b821-f3cbb68f73ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:21.664509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4051a5b-e8de-4d87-b821-f3cbb68f73ef admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:21.676436 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1280/2550] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:42:21.680824 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:21.691586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077f824-31a2-4fcf-889a-7f651201e4c5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:21.696994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:21.697645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.697922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.698191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] PATH_INFO: `/v3/projects/a0d6c23eb374485890722cdf2df5e917/users/94c066dfb6a4472ea54e225879c4c179/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.713302 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d6c23eb374485890722cdf2df5e917, user_id=94c066dfb6a4472ea54e225879c4c179, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:21.715942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:21.793884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1271/2551] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:21 2022] PUT /identity/v3/projects/a0d6c23eb374485890722cdf2df5e917/users/94c066dfb6a4472ea54e225879c4c179/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:21.805379 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947422-41a5-4d08-8300-abfcc15fa360 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.805659 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947422-41a5-4d08-8300-abfcc15fa360 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.805930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947422-41a5-4d08-8300-abfcc15fa360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.834851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-87947422-41a5-4d08-8300-abfcc15fa360 None None] MFA Rules not processed for user `94c066dfb6a4472ea54e225879c4c179`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:21.836128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-87947422-41a5-4d08-8300-abfcc15fa360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:21.901718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1281/2552] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:21.906182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:21.969228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad4fde-fcaf-42b6-a95c-674161d1574d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:21.973969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:21.974574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:21.974854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:21.975124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:21.975798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:21.977693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:22.095654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1272/2553] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:42:21 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:22.099697 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947422-41a5-4d08-8300-abfcc15fa360 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:22.111075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947422-41a5-4d08-8300-abfcc15fa360 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:22.168478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:22.169327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:22.169327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:22.169612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:22.170249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:22.172724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:22.269070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1282/2554] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:42:22 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:22.273281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:22.284739 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24b277-f28c-48c2-9295-10846ca527c6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:22.289778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:22.290385 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:22.290666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:22.290940 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:22.291642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:22.293331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:22.305517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1273/2555] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:42:22.316894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:22.330444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccfcde-1e21-4bfc-915a-7611f244a8b7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:22.336928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:22.337778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:22.338063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:22.338346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] PATH_INFO: `/v3/projects/a601554479234b3c90ad4b58ec86d380/users/a82601179db14c2baaad89092d1690e8/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:22.354465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a601554479234b3c90ad4b58ec86d380, user_id=a82601179db14c2baaad89092d1690e8, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:22.357173 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:22.470143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1283/2556] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:22 2022] PUT /identity/v3/projects/a601554479234b3c90ad4b58ec86d380/users/a82601179db14c2baaad89092d1690e8/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:22.474130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:22.484413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2b506-cdd1-4021-84b2-7e90e9505078 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:22.544065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f06b-2e5a-47e9-ad55-9132b2080066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:22.544597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f06b-2e5a-47e9-ad55-9132b2080066 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:22.544862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f06b-2e5a-47e9-ad55-9132b2080066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:22.545131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f06b-2e5a-47e9-ad55-9132b2080066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:22.545762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f06b-2e5a-47e9-ad55-9132b2080066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:22.547867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f06b-2e5a-47e9-ad55-9132b2080066 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:22.549165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:22.558177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1274/2557] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:22.562430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:22.573741 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61a7ec-5433-48c1-a3f5-15b83a7c5f4f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:22.578355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:22.579032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:22.579307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:22.579618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] PATH_INFO: `/v3/projects/a601554479234b3c90ad4b58ec86d380/users/a82601179db14c2baaad89092d1690e8/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:22.581526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a601554479234b3c90ad4b58ec86d380, user_id=a82601179db14c2baaad89092d1690e8, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:22.584164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:22.595142 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1284/2558] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:22 2022] PUT /identity/v3/projects/a601554479234b3c90ad4b58ec86d380/users/a82601179db14c2baaad89092d1690e8/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:22.610825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e351-95f0-4d77-8b9f-8dda0348932f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:22.611113 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e351-95f0-4d77-8b9f-8dda0348932f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:22.611411 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17e351-95f0-4d77-8b9f-8dda0348932f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:22.640631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0b17e351-95f0-4d77-8b9f-8dda0348932f None None] MFA Rules not processed for user `a82601179db14c2baaad89092d1690e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:22.642239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0b17e351-95f0-4d77-8b9f-8dda0348932f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:22.710726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1275/2559] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:42:22.722355 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:22.733297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:22.733297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:22.782448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f82793-c53f-41e5-b333-a28a558a077a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:22.786316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1431d8-c427-4198-a0cb-11e392eebfd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:22.786951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1431d8-c427-4198-a0cb-11e392eebfd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:22.787227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1431d8-c427-4198-a0cb-11e392eebfd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:22.798426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1431d8-c427-4198-a0cb-11e392eebfd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:22.798426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1431d8-c427-4198-a0cb-11e392eebfd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:22.798905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1431d8-c427-4198-a0cb-11e392eebfd7 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:22.809269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1285/2560] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:23.380093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17e351-95f0-4d77-8b9f-8dda0348932f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:23.444159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17e351-95f0-4d77-8b9f-8dda0348932f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:23.448734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:23.449360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:23.449637 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:23.449905 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] PATH_INFO: `/v3/users/94c066dfb6a4472ea54e225879c4c179` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:23.451035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c066dfb6a4472ea54e225879c4c179)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:23.453000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:23.662645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c066dfb6a4472ea54e225879c4c179'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:23.779479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c066dfb6a4472ea54e225879c4c179'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:23.793513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c066dfb6a4472ea54e225879c4c179'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:23.795054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c066dfb6a4472ea54e225879c4c179'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:23.803825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c066dfb6a4472ea54e225879c4c179'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:23.806023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:23.810347 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1276/2561] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:23 2022] DELETE /identity/v3/users/94c066dfb6a4472ea54e225879c4c179 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:23.815778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:23.816309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:23.816417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:23.836897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:23.840069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:23.899112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1286/2562] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:23.909032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:23.910464 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:23.968537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4925c7-8e2d-488e-a06f-50c87d387060 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:23.972079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:23.972685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:23.972966 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:23.973242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:23.982291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:23.983759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:23.994076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1277/2563] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:24.413278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:24.414900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:24.430011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbafe32-308a-49fe-8f1e-8c4977660059 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:24.437965 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:24.440276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:24.440276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:24.440276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] PATH_INFO: `/v3/projects/a0d6c23eb374485890722cdf2df5e917` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:24.441833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d6c23eb374485890722cdf2df5e917)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:24.444967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:24.576995 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d6c23eb374485890722cdf2df5e917', 'request_id': 'req-1fb19278-e8fd-4da6-b8db-11739995d24f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:24.679821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d6c23eb374485890722cdf2df5e917', 'request_id': 'req-1fb19278-e8fd-4da6-b8db-11739995d24f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:24.687538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d6c23eb374485890722cdf2df5e917', 'request_id': 'req-1fb19278-e8fd-4da6-b8db-11739995d24f'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:24.702348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] The token cache is being invalidate because project a0d6c23eb374485890722cdf2df5e917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:24.702647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:24.703869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:24.705529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1287/2564] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:24 2022] DELETE /identity/v3/projects/a0d6c23eb374485890722cdf2df5e917 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:24.709666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:24.720771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e816f0-9f35-4620-9c0d-09fc14d1734e service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:24.792380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:24.793039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:24.793328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:24.794066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] PATH_INFO: `/v3/users/a82601179db14c2baaad89092d1690e8` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:24.794887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82601179db14c2baaad89092d1690e8)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:24.796891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:24.977492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82601179db14c2baaad89092d1690e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.044980 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82601179db14c2baaad89092d1690e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.059040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82601179db14c2baaad89092d1690e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.059783 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82601179db14c2baaad89092d1690e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.074360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-637b52a3-2a26-494a-a31f-0dfe7eb49eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82601179db14c2baaad89092d1690e8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.081316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1278/2565] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:24 2022] DELETE /identity/v3/users/a82601179db14c2baaad89092d1690e8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:25.532339 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:25.533825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:25.550128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb19278-e8fd-4da6-b8db-11739995d24f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:25.578677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:25.609060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:25.610291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:25.610571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:25.610842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] PATH_INFO: `/v3/projects/a601554479234b3c90ad4b58ec86d380` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:25.612013 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a601554479234b3c90ad4b58ec86d380)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:25.613935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:25.788673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a601554479234b3c90ad4b58ec86d380', 'request_id': 'req-f4e54f5e-9add-4e14-a93e-6970398d257c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.879133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a601554479234b3c90ad4b58ec86d380', 'request_id': 'req-f4e54f5e-9add-4e14-a93e-6970398d257c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.886117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a601554479234b3c90ad4b58ec86d380', 'request_id': 'req-f4e54f5e-9add-4e14-a93e-6970398d257c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.897821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] The token cache is being invalidate because project a601554479234b3c90ad4b58ec86d380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:25.898106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.898752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f4e54f5e-9add-4e14-a93e-6970398d257c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:25.900340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1288/2566] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:25 2022] DELETE /identity/v3/projects/a601554479234b3c90ad4b58ec86d380 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:25.905308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704ce1-9131-4708-895b-1c6245f7b8db None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:25.905802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704ce1-9131-4708-895b-1c6245f7b8db None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:25.905928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704ce1-9131-4708-895b-1c6245f7b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:25.926778 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0a704ce1-9131-4708-895b-1c6245f7b8db None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:25.928033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0a704ce1-9131-4708-895b-1c6245f7b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:25.945695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:25.990400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1279/2567] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:25.998338 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692e51-2998-4daf-9e11-132d08fc6535 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:25.998628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692e51-2998-4daf-9e11-132d08fc6535 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:25.998905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692e51-2998-4daf-9e11-132d08fc6535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.020909 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-18692e51-2998-4daf-9e11-132d08fc6535 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:26.022151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-18692e51-2998-4daf-9e11-132d08fc6535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:26.030062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1289/2568] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:26.034598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704ce1-9131-4708-895b-1c6245f7b8db None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.044389 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704ce1-9131-4708-895b-1c6245f7b8db None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.049890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.050494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.050774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.051045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.051811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:42:26.052115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.053710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:26.070470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1280/2569] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:42:26.078812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692e51-2998-4daf-9e11-132d08fc6535 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.081316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692e51-2998-4daf-9e11-132d08fc6535 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.086389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.087000 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.087281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.087574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.088221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.090291 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:26.181978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1290/2570] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:42:26 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:26.186206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.197087 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba5aa1-73fa-49ce-9c7c-94de8f8d8073 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.254191 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.254810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.255089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.255388 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.256032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.257953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:26.348539 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1281/2571] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:42:26 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:26.352747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.363747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f1147-4379-4a34-8d4a-e3c9183276cf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.368435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.369031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.369307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.369573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.370206 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.371825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:26.382906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1291/2572] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:26.387329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.397606 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bfc39-9aed-4116-a1b3-7dd1eb4855a9 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.402231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f640-043a-4a33-bd0f-46441f563c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.402835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f640-043a-4a33-bd0f-46441f563c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.403108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f640-043a-4a33-bd0f-46441f563c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.403407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f640-043a-4a33-bd0f-46441f563c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.404047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f640-043a-4a33-bd0f-46441f563c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.405619 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f640-043a-4a33-bd0f-46441f563c18 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:26.416792 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1282/2573] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:26.421159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.431844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ce283-909a-46ba-9b9d-e59cfd9e4cb9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.436576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.437148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.437427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.437822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] PATH_INFO: `/v3/projects/6cda1a7afcaf40099fc36aaacfe20085/users/f1b4b39a31e045fb827bdd0f6b152863/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.452781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cda1a7afcaf40099fc36aaacfe20085, user_id=f1b4b39a31e045fb827bdd0f6b152863, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.458066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:26.554354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1292/2574] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:26 2022] PUT /identity/v3/projects/6cda1a7afcaf40099fc36aaacfe20085/users/f1b4b39a31e045fb827bdd0f6b152863/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:26.567147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6906f1-39be-408c-be85-e8a8c380bd9a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.567467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6906f1-39be-408c-be85-e8a8c380bd9a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.567745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6906f1-39be-408c-be85-e8a8c380bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.596937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3b6906f1-39be-408c-be85-e8a8c380bd9a None None] MFA Rules not processed for user `f1b4b39a31e045fb827bdd0f6b152863`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:26.598149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3b6906f1-39be-408c-be85-e8a8c380bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:26.665855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1283/2575] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:26.678407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.680278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:26.737902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074421b-01cf-4606-a72d-56c3db1b8376 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.741509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515c316-dba4-4be4-af1b-ea330051cf60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.742102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515c316-dba4-4be4-af1b-ea330051cf60 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.742380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515c316-dba4-4be4-af1b-ea330051cf60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.742649 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515c316-dba4-4be4-af1b-ea330051cf60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.750951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515c316-dba4-4be4-af1b-ea330051cf60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.752528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515c316-dba4-4be4-af1b-ea330051cf60 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:26.755966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:26.762067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1293/2576] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:26.785957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6906f1-39be-408c-be85-e8a8c380bd9a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:26.807203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:26.851178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6906f1-39be-408c-be85-e8a8c380bd9a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:26.856172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:26.856820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:26.857102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:26.857378 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] PATH_INFO: `/v3/users/f1b4b39a31e045fb827bdd0f6b152863` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:26.858577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b4b39a31e045fb827bdd0f6b152863)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:26.860645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:27.069658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b4b39a31e045fb827bdd0f6b152863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:27.122406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b4b39a31e045fb827bdd0f6b152863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:27.140488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b4b39a31e045fb827bdd0f6b152863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:27.141195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b4b39a31e045fb827bdd0f6b152863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:27.149835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b4b39a31e045fb827bdd0f6b152863'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:27.155821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1284/2577] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:26 2022] DELETE /identity/v3/users/f1b4b39a31e045fb827bdd0f6b152863 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:27.160807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:27.161087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:27.161390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:27.180253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:27.181451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:27.239227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1294/2578] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:27.249049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:27.250534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:27.308854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b632f-918d-4ecc-a8e3-4dfba7169b0c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:27.312675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2d7d2-f48e-47bb-a6a3-772fac9d3d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:27.313285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2d7d2-f48e-47bb-a6a3-772fac9d3d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:27.313586 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2d7d2-f48e-47bb-a6a3-772fac9d3d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:27.313858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2d7d2-f48e-47bb-a6a3-772fac9d3d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:27.323287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2d7d2-f48e-47bb-a6a3-772fac9d3d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:27.324747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2d7d2-f48e-47bb-a6a3-772fac9d3d14 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:27.336048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1285/2579] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:27.897698 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:27.899198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:27.911499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24767a-671e-44f7-b26e-96ceadd2260a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:27.916742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:27.917539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:27.917857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:27.918100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] PATH_INFO: `/v3/projects/6cda1a7afcaf40099fc36aaacfe20085` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:27.919443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cda1a7afcaf40099fc36aaacfe20085)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:27.921445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:28.063200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cda1a7afcaf40099fc36aaacfe20085', 'request_id': 'req-794c48bd-ab11-4360-a689-4b043a6c1f20'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:28.142076 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cda1a7afcaf40099fc36aaacfe20085', 'request_id': 'req-794c48bd-ab11-4360-a689-4b043a6c1f20'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:28.148535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cda1a7afcaf40099fc36aaacfe20085', 'request_id': 'req-794c48bd-ab11-4360-a689-4b043a6c1f20'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:28.161316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] The token cache is being invalidate because project 6cda1a7afcaf40099fc36aaacfe20085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:28.161601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:28.162243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-794c48bd-ab11-4360-a689-4b043a6c1f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:28.163769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1295/2580] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:27 2022] DELETE /identity/v3/projects/6cda1a7afcaf40099fc36aaacfe20085 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:28.168727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beb65b-051e-41bb-8c83-b626280e2f0e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.169245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beb65b-051e-41bb-8c83-b626280e2f0e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.169344 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83beb65b-051e-41bb-8c83-b626280e2f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.190305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-83beb65b-051e-41bb-8c83-b626280e2f0e None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:28.191560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-83beb65b-051e-41bb-8c83-b626280e2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:28.228304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:28.253930 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1286/2581] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:28.262417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a994-038d-484d-9b8a-1cfae31ce57c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.262701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a994-038d-484d-9b8a-1cfae31ce57c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.262978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66a994-038d-484d-9b8a-1cfae31ce57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.283369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cc66a994-038d-484d-9b8a-1cfae31ce57c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:28.285553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cc66a994-038d-484d-9b8a-1cfae31ce57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:28.293636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1296/2582] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:28.301190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beb65b-051e-41bb-8c83-b626280e2f0e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:28.310917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83beb65b-051e-41bb-8c83-b626280e2f0e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:28.316241 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:28.316781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.317060 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.317332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.317985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:42:28.318282 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:28.319932 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:28.332574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1287/2583] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:42:28.337547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a994-038d-484d-9b8a-1cfae31ce57c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:28.347483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66a994-038d-484d-9b8a-1cfae31ce57c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:28.352292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:28.352911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.353191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.353463 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.354108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:28.356101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:28.494944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1297/2584] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:42:28 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:28.498811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:28.509617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e77c30-451e-4f42-bf24-f85e0b41d170 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:28.570837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:28.571535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.571814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.572122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.572774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:28.574771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:28.702854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1288/2585] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:42:28 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:28.707917 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:28.718437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da25f7-7f91-438c-8696-7c51427feedb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:28.723802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:28.726493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.726493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.726493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.726493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:28.727276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:28.737800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1298/2586] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:28.741741 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:28.752126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08bf96-da2e-435d-9d4b-3ba07081f719 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:28.757485 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961ccf3-1ab6-4b8c-88d9-273044d675cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:28.758091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961ccf3-1ab6-4b8c-88d9-273044d675cb admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.758371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961ccf3-1ab6-4b8c-88d9-273044d675cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.758674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961ccf3-1ab6-4b8c-88d9-273044d675cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.759312 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961ccf3-1ab6-4b8c-88d9-273044d675cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:28.761258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961ccf3-1ab6-4b8c-88d9-273044d675cb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:28.774197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1289/2587] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:28.778452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:28.789866 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787049-bc4e-4952-9ff0-ed304f77fa7a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:28.794838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:28.795525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:28.795835 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:28.796131 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] PATH_INFO: `/v3/projects/c6d37dc5b1e6419a90798caf2937d072/users/22c11abdc39d4f208fe0ddcdfded56e5/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:28.811759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d37dc5b1e6419a90798caf2937d072, user_id=22c11abdc39d4f208fe0ddcdfded56e5, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:28.814402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:29.027830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1299/2588] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:28 2022] PUT /identity/v3/projects/c6d37dc5b1e6419a90798caf2937d072/users/22c11abdc39d4f208fe0ddcdfded56e5/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:29.039515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2af3c-aeb3-4a60-a728-6318b1a1e914 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:29.039833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2af3c-aeb3-4a60-a728-6318b1a1e914 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:29.040111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2af3c-aeb3-4a60-a728-6318b1a1e914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:29.068983 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-20d2af3c-aeb3-4a60-a728-6318b1a1e914 None None] MFA Rules not processed for user `22c11abdc39d4f208fe0ddcdfded56e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:29.071470 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-20d2af3c-aeb3-4a60-a728-6318b1a1e914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:29.138415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1290/2589] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:29.150044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:29.152897 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:29.174136 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:29.212932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3c890-4faf-45b9-8f0f-59839fa11fb7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:29.216587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5df175-eae4-4527-9131-9be5265379b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:29.217218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5df175-eae4-4527-9131-9be5265379b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:29.217499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5df175-eae4-4527-9131-9be5265379b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:29.217773 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5df175-eae4-4527-9131-9be5265379b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:29.226543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5df175-eae4-4527-9131-9be5265379b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:29.228025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5df175-eae4-4527-9131-9be5265379b8 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:29.236830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1300/2590] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:36.363463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2af3c-aeb3-4a60-a728-6318b1a1e914 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:36.406873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:36.429910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2af3c-aeb3-4a60-a728-6318b1a1e914 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:36.434577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:36.435206 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:36.435514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:36.435787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] PATH_INFO: `/v3/users/22c11abdc39d4f208fe0ddcdfded56e5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:36.436910 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c11abdc39d4f208fe0ddcdfded56e5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:36.438818 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:36.612875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c11abdc39d4f208fe0ddcdfded56e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:36.704680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c11abdc39d4f208fe0ddcdfded56e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:36.718501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c11abdc39d4f208fe0ddcdfded56e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:36.719179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c11abdc39d4f208fe0ddcdfded56e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:36.728575 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c11abdc39d4f208fe0ddcdfded56e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:36.732881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1291/2591] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:36 2022] DELETE /identity/v3/users/22c11abdc39d4f208fe0ddcdfded56e5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:36.737558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:36.738374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:36.738554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:36.758906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:36.760397 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:36.825302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1301/2592] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:36.835720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:36.837234 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:36.919438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727f31-256b-44c4-950b-538905501a30 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:36.923259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:36.923894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:36.924169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:36.924434 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:36.934761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:36.936231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:36.948308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1292/2593] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:42:36.968947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:36.970499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:36.983087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff62b-05ee-4f07-a815-0d9a7a485e45 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:36.986988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d47e-2ecf-4e1f-90b1-ecb414639ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:36.987673 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d47e-2ecf-4e1f-90b1-ecb414639ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:36.988100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d47e-2ecf-4e1f-90b1-ecb414639ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:36.988232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d47e-2ecf-4e1f-90b1-ecb414639ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:36.990628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5f24d47e-2ecf-4e1f-90b1-ecb414639ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:37.057227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d47e-2ecf-4e1f-90b1-ecb414639ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:37.058700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d47e-2ecf-4e1f-90b1-ecb414639ea3 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:37.069443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1302/2594] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:37.432719 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:37.435190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:37.460708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f499f4-1a43-4e0b-9411-b60aec6a32f2 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:37.466041 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:37.466881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:37.471609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:37.471609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] PATH_INFO: `/v3/projects/c6d37dc5b1e6419a90798caf2937d072` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:37.471609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d37dc5b1e6419a90798caf2937d072)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:37.471609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:37.589656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:37.603973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d37dc5b1e6419a90798caf2937d072', 'request_id': 'req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:37.705593 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d37dc5b1e6419a90798caf2937d072', 'request_id': 'req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:37.712892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d37dc5b1e6419a90798caf2937d072', 'request_id': 'req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:37.725871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] The token cache is being invalidate because project c6d37dc5b1e6419a90798caf2937d072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:37.726221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:37.727145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-e3bfadb5-fd71-41b9-8262-4fe80869f5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:37.728977 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1293/2595] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:37 2022] DELETE /identity/v3/projects/c6d37dc5b1e6419a90798caf2937d072 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:37.734862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535215-4f71-445f-a552-9bef6a060514 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:37.735266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535215-4f71-445f-a552-9bef6a060514 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:37.735727 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535215-4f71-445f-a552-9bef6a060514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:37.755725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0c535215-4f71-445f-a552-9bef6a060514 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:37.756929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0c535215-4f71-445f-a552-9bef6a060514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:37.816950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:37.825447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1303/2596] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:37.833735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34301317-0cb5-49ef-b2a3-7900177dfe1b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:37.833991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34301317-0cb5-49ef-b2a3-7900177dfe1b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:37.834414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34301317-0cb5-49ef-b2a3-7900177dfe1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:37.856465 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-34301317-0cb5-49ef-b2a3-7900177dfe1b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:37.858070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-34301317-0cb5-49ef-b2a3-7900177dfe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:37.866256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1294/2597] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:42:37.870624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c535215-4f71-445f-a552-9bef6a060514 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:37.882004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c535215-4f71-445f-a552-9bef6a060514 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:37.887509 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:37.888122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:37.888400 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:37.888670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:37.889324 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:42:37.889626 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:37.891288 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:37.904480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1304/2598] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:42:37.913042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34301317-0cb5-49ef-b2a3-7900177dfe1b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:37.923083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34301317-0cb5-49ef-b2a3-7900177dfe1b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:37.928235 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:37.928852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:37.929201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:37.929482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:37.930127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:37.932095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:38.101620 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1295/2599] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:42:37 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:42:38.105642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:38.116928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cde3f-bf60-43df-8e4d-873646b93243 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:38.179508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:38.180187 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:38.180543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:38.180891 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:38.181620 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:38.183648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:38.356871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1305/2600] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:42:38 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:42:38.389329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:38.389329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e13823-d5b7-469e-b1f0-4c5b2eb62493 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:38.389329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:38.389329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:38.390085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:38.390085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:38.390085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:38.390085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:38.397453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1296/2601] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:42:38.399167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:38.410404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779f2a3-6d37-4b6f-9cd3-a6dd22be9a67 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:38.415586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ad61b-8c63-4b92-a9f9-5bc5a54fafa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:38.416322 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad61b-8c63-4b92-a9f9-5bc5a54fafa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:38.416876 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad61b-8c63-4b92-a9f9-5bc5a54fafa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:38.417262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad61b-8c63-4b92-a9f9-5bc5a54fafa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:38.418028 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ad61b-8c63-4b92-a9f9-5bc5a54fafa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:38.419933 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ad61b-8c63-4b92-a9f9-5bc5a54fafa4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:38.432402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1306/2602] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:42:38.436559 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:38.449197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe697f-9c67-4b76-81e8-856567d800dd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:38.469768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:38.469768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:38.469768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:38.469768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] PATH_INFO: `/v3/projects/7e0c4eb438e9486abc581b62b80d1704/users/8a846456b1324999bf0d6a73a62038d5/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:38.478855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0c4eb438e9486abc581b62b80d1704, user_id=8a846456b1324999bf0d6a73a62038d5, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:38.481701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:38.664964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1297/2603] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:42:38 2022] PUT /identity/v3/projects/7e0c4eb438e9486abc581b62b80d1704/users/8a846456b1324999bf0d6a73a62038d5/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:38.675415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:38.675758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:38.676006 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:38.709986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] MFA Rules not processed for user `8a846456b1324999bf0d6a73a62038d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:38.715491 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:38.816550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1307/2604] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:42:38.827275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:38.829299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:38.897324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1bb50-96d0-4a58-87e4-b20c8d18683a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:38.904615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:38.904615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:38.904615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:38.904615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:38.912772 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:38.914365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:38.925210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1298/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:43.911278 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:43.912747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:43.974758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7da29f-107b-4999-90e3-668f5741dbc8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:43.979272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:43.979915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:43.980198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:43.980473 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:43.982375 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:43.993351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:44.050506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:44.051987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:44.062911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1308/2606] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:42:49.359008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:52.353815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:52.370500 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:52.371456 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a326a-eb97-4f0d-bfa9-ddbae5d416b1 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:52.373191 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:52.377106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:52.377887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:52.378629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:52.379024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] PATH_INFO: `/v3/users/8a846456b1324999bf0d6a73a62038d5` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:52.380472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a846456b1324999bf0d6a73a62038d5)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:52.382547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:52.482160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6911-57bf-4c42-8f1b-18fe5549beb5 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:52.487177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:52.487814 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:52.488175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:52.488451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:52.490269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:52.502472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:52.504121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:52.515107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1309/2607] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:42:52.572928 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:52.575099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:52.590236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc726e-3d84-4734-9cb5-03ac77f8c615 service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:52.597480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:52.599796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:52.599796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:52.599796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] PATH_INFO: `/v3/users/6666a5d0fee44372801adb6effbf0b0c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:52.599796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6666a5d0fee44372801adb6effbf0b0c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:52.602339 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:52.607174 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a846456b1324999bf0d6a73a62038d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.687400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a846456b1324999bf0d6a73a62038d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.701197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a846456b1324999bf0d6a73a62038d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.705628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a846456b1324999bf0d6a73a62038d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.709032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-453bb86f-9690-4adf-9256-e1ff467d9d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a846456b1324999bf0d6a73a62038d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.715571 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1299/2608] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:52 2022] DELETE /identity/v3/users/8a846456b1324999bf0d6a73a62038d5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:52.720086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:52.720376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:52.720668 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:52.749556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:42:52.749556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:52.808469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1300/2609] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:42:52.819853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:52.821450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:52.864884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6666a5d0fee44372801adb6effbf0b0c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.864884 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6666a5d0fee44372801adb6effbf0b0c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.874446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6666a5d0fee44372801adb6effbf0b0c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.894340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6666a5d0fee44372801adb6effbf0b0c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:52.898468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7a869-b182-4a3b-945d-cdacd7e0af34 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:52.901651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:52.910161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:52.910161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:52.910161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:52.910161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:52.912018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:52.926763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:52.928433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:52.952252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1301/2610] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:42:53.015494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6666a5d0fee44372801adb6effbf0b0c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:53.023167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1310/2611] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:52 2022] DELETE /identity/v3/users/6666a5d0fee44372801adb6effbf0b0c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:53.623163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:53.625635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:53.639761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246645a3-a0db-4c86-ba68-6a89bb0c1199 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:53.663164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:53.665038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:53.667602 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:53.720274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:53.720927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:53.721208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:53.721486 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] PATH_INFO: `/v3/projects/7e0c4eb438e9486abc581b62b80d1704` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:53.722710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0c4eb438e9486abc581b62b80d1704)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:53.724873 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:53.750312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed8350-5ab7-419d-b69e-f4298bf69c0d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:53.755264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:53.755955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:53.756237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:53.757602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] PATH_INFO: `/v3/projects/576436be7c1d459ba5c2f854768973ab` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:53.759088 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576436be7c1d459ba5c2f854768973ab)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:53.761335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:53.915045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0c4eb438e9486abc581b62b80d1704', 'request_id': 'req-2af6a590-1113-4665-884b-85c6b603c7d4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:53.930865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576436be7c1d459ba5c2f854768973ab', 'request_id': 'req-31d9fdbf-ac86-4f77-a49f-6be282be76e9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.089835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0c4eb438e9486abc581b62b80d1704', 'request_id': 'req-2af6a590-1113-4665-884b-85c6b603c7d4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.097842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0c4eb438e9486abc581b62b80d1704', 'request_id': 'req-2af6a590-1113-4665-884b-85c6b603c7d4'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.113502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] The token cache is being invalidate because project 7e0c4eb438e9486abc581b62b80d1704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:54.113810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.114487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.117202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1302/2612] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:53 2022] DELETE /identity/v3/projects/7e0c4eb438e9486abc581b62b80d1704 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:42:54.169844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576436be7c1d459ba5c2f854768973ab', 'request_id': 'req-31d9fdbf-ac86-4f77-a49f-6be282be76e9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.177700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576436be7c1d459ba5c2f854768973ab', 'request_id': 'req-31d9fdbf-ac86-4f77-a49f-6be282be76e9'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.191561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] The token cache is being invalidate because project 576436be7c1d459ba5c2f854768973ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:54.191863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.192543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.194962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1311/2613] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:53 2022] DELETE /identity/v3/projects/576436be7c1d459ba5c2f854768973ab => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:54.199138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:54.200899 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:54.284550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a590-1113-4665-884b-85c6b603c7d4 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:54.339194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:54.349761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:54.351185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:54.351709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:54.352019 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] PATH_INFO: `/v3/users/999777b5f4c847199dfe865a85f6b962` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:54.353264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=999777b5f4c847199dfe865a85f6b962)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:54.355246 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:54.653147 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999777b5f4c847199dfe865a85f6b962'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.752809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999777b5f4c847199dfe865a85f6b962'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.768710 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999777b5f4c847199dfe865a85f6b962'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.769544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999777b5f4c847199dfe865a85f6b962'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.778882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-598640ed-06bf-4cc3-865f-328e357d8a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999777b5f4c847199dfe865a85f6b962'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:54.785148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1303/2614] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:42:54 2022] DELETE /identity/v3/users/999777b5f4c847199dfe865a85f6b962 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:42:55.091415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:42:55.092870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:42:55.107721 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9fdbf-ac86-4f77-a49f-6be282be76e9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:42:55.166622 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:42:55.167286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:42:55.167607 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:42:55.167859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] PATH_INFO: `/v3/projects/70f87d2a8cce41c2882dac97983d037a` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:42:55.168971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f87d2a8cce41c2882dac97983d037a)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:42:55.170858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:42:55.201983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:42:55.299803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f87d2a8cce41c2882dac97983d037a', 'request_id': 'req-9cbff15a-efca-415e-b570-52de933ecafb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:55.389843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f87d2a8cce41c2882dac97983d037a', 'request_id': 'req-9cbff15a-efca-415e-b570-52de933ecafb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:55.396039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f87d2a8cce41c2882dac97983d037a', 'request_id': 'req-9cbff15a-efca-415e-b570-52de933ecafb'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:55.407813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] The token cache is being invalidate because project 70f87d2a8cce41c2882dac97983d037a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:42:55.408106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:55.408785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:42:55.410259 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1312/2615] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:42:55 2022] DELETE /identity/v3/projects/70f87d2a8cce41c2882dac97983d037a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:43:04.515109 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:04.515973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:04.515973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:04.554195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:04.555496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:04.640424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1304/2616] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:43:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:43:04.879611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:04.879611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:04.982978 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbff15a-efca-415e-b570-52de933ecafb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:04.988785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf70cb9-b6fa-47a4-827d-c9f12de168f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:04.989412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf70cb9-b6fa-47a4-827d-c9f12de168f0 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:04.991320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf70cb9-b6fa-47a4-827d-c9f12de168f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:04.991320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf70cb9-b6fa-47a4-827d-c9f12de168f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:05.003225 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf70cb9-b6fa-47a4-827d-c9f12de168f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:05.005849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf70cb9-b6fa-47a4-827d-c9f12de168f0 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:05.017127 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1313/2617] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:43:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 12:43:14.631299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:43:15.013255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:43:23.554161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:23.559496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:23.647372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d50b1-1507-4898-8536-b3163d417d28 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:23.652809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d675-a8ca-40dc-8573-9f4ca557cddd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:23.653427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d675-a8ca-40dc-8573-9f4ca557cddd service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:23.653711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d675-a8ca-40dc-8573-9f4ca557cddd service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:23.653984 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d675-a8ca-40dc-8573-9f4ca557cddd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:23.655786 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-76a5d675-a8ca-40dc-8573-9f4ca557cddd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:23.668756 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5d675-a8ca-40dc-8573-9f4ca557cddd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:23.670856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5d675-a8ca-40dc-8573-9f4ca557cddd service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:23.682076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1305/2618] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:43:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:43:27.851524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7387a83-dd9b-4179-b3f8-d226d1d490a6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:27.852468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7387a83-dd9b-4179-b3f8-d226d1d490a6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:27.852468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7387a83-dd9b-4179-b3f8-d226d1d490a6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:27.853602 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1314/2619] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:43:27.859548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1608d1-a7a7-443f-ba1e-4aac9d0125c2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:27.860014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1608d1-a7a7-443f-ba1e-4aac9d0125c2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:27.860124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1608d1-a7a7-443f-ba1e-4aac9d0125c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:27.893335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-dc1608d1-a7a7-443f-ba1e-4aac9d0125c2 None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:27.894547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dc1608d1-a7a7-443f-ba1e-4aac9d0125c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:27.998504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1306/2620] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:43:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:28.011328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7387a83-dd9b-4179-b3f8-d226d1d490a6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:28.013060 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c7387a83-dd9b-4179-b3f8-d226d1d490a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:28.077089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7387a83-dd9b-4179-b3f8-d226d1d490a6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:28.080592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c724c97-1ef1-47c8-b1ed-0b07d992d7ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '957e46599f5d4d21b822e8c9ce1480b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:28.081205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724c97-1ef1-47c8-b1ed-0b07d992d7ee service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:28.081486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724c97-1ef1-47c8-b1ed-0b07d992d7ee service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:28.081758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724c97-1ef1-47c8-b1ed-0b07d992d7ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:28.093327 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c724c97-1ef1-47c8-b1ed-0b07d992d7ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:28.094771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c724c97-1ef1-47c8-b1ed-0b07d992d7ee service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:28.105898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1315/2621] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:43:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:43:28.388535 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14398b3e-acbc-4111-bd0c-64283ced9029 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:28.388897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14398b3e-acbc-4111-bd0c-64283ced9029 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:28.389231 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14398b3e-acbc-4111-bd0c-64283ced9029 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:28.390760 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1307/2622] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:43:28.395600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482d30-417d-44c9-8c50-e7ccd1c62f6a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:28.395911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482d30-417d-44c9-8c50-e7ccd1c62f6a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:28.396184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7482d30-417d-44c9-8c50-e7ccd1c62f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:28.417346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a7482d30-417d-44c9-8c50-e7ccd1c62f6a None None] MFA Rules not processed for user `5c06385b20074363b3a5f7216947280b`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:28.418587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a7482d30-417d-44c9-8c50-e7ccd1c62f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:28.479440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1316/2623] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:43:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:28.493195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14398b3e-acbc-4111-bd0c-64283ced9029 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:28.495304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-14398b3e-acbc-4111-bd0c-64283ced9029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:28.511201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14398b3e-acbc-4111-bd0c-64283ced9029 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:28.515072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bac7b-9f1e-4e71-970e-d2e5f283454d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:28.515715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bac7b-9f1e-4e71-970e-d2e5f283454d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:28.516039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bac7b-9f1e-4e71-970e-d2e5f283454d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:28.521373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bac7b-9f1e-4e71-970e-d2e5f283454d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:28.524031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bac7b-9f1e-4e71-970e-d2e5f283454d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:28.525475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bac7b-9f1e-4e71-970e-d2e5f283454d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:28.533951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1308/2624] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:43:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:43:28.621681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0de829-bdb4-4dec-b1d8-2e87e580138f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:28.621969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0de829-bdb4-4dec-b1d8-2e87e580138f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:28.622244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0de829-bdb4-4dec-b1d8-2e87e580138f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:28.623787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1317/2625] 10.222.0.49 () {54 vars in 921 bytes} [Mon Sep 26 12:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 12:43:28.630163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f92b-ea9c-4824-b4cc-d769e86acf2a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:28.634731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f92b-ea9c-4824-b4cc-d769e86acf2a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:28.634731 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87f92b-ea9c-4824-b4cc-d769e86acf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:28.659717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2d87f92b-ea9c-4824-b4cc-d769e86acf2a None None] MFA Rules not processed for user `952c5c9a37a54497aab20652d0282690`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:28.660925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d87f92b-ea9c-4824-b4cc-d769e86acf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:28.682006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1309/2626] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Sep 26 12:43:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:28.694386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0de829-bdb4-4dec-b1d8-2e87e580138f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:28.696181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ce0de829-bdb4-4dec-b1d8-2e87e580138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:28.709547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0de829-bdb4-4dec-b1d8-2e87e580138f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:28.713128 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f03e9-666c-4f34-a431-2e5a41802d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:28.713725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f03e9-666c-4f34-a431-2e5a41802d50 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:28.714003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f03e9-666c-4f34-a431-2e5a41802d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:28.714270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f03e9-666c-4f34-a431-2e5a41802d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:28.724577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f03e9-666c-4f34-a431-2e5a41802d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:28.728919 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f03e9-666c-4f34-a431-2e5a41802d50 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:28.737648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1318/2627] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:43:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:43:30.875011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87f92b-ea9c-4824-b4cc-d769e86acf2a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:30.886260 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87f92b-ea9c-4824-b4cc-d769e86acf2a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:30.890633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:30.891290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:30.891601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:30.891869 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:30.895332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:30.941747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:43:30.967215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:30.968709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:30.980502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1310/2628] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:43:31.738341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:31.738870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:31.738976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:31.759587 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:31.761118 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:31.768540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1319/2629] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Sep 26 12:43:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:31.780853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:31.793037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bacb0-5686-404d-af61-bce862c1bb4d service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:31.798033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:31.798639 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:31.798967 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:31.799179 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:31.808626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:31.810247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:31.818735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1311/2630] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:43:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:43:35.876755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:35.879164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:35.904541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb149d-0534-4de0-8898-ad16dde15fcb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:35.909449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:35.910086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:35.910367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:35.910641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] PATH_INFO: `/v3/users/e5496f0182f44d4d891959fe7422562c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:35.912153 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5496f0182f44d4d891959fe7422562c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:35.914626 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:36.128183 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5496f0182f44d4d891959fe7422562c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.128864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5496f0182f44d4d891959fe7422562c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.138415 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5496f0182f44d4d891959fe7422562c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.155839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5496f0182f44d4d891959fe7422562c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.217494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-547b9550-2ee5-42d9-bd26-ea36edc983b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5496f0182f44d4d891959fe7422562c'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.224686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1320/2631] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:43:35 2022] DELETE /identity/v3/users/e5496f0182f44d4d891959fe7422562c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:43:36.500623 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:36.517323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daec9b8-71c0-44ce-b453-73cc7aa84540 service swift] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:36.600829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:36.601462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:36.601749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:36.602028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] PATH_INFO: `/v3/projects/3f9686d8c3b74155a4427357a40dfdb2` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:36.603223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9686d8c3b74155a4427357a40dfdb2)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:36.605294 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:36.750424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9686d8c3b74155a4427357a40dfdb2', 'request_id': 'req-6de2142c-18cd-4f35-a26b-f8c836f832d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.821004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9686d8c3b74155a4427357a40dfdb2', 'request_id': 'req-6de2142c-18cd-4f35-a26b-f8c836f832d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.828520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9686d8c3b74155a4427357a40dfdb2', 'request_id': 'req-6de2142c-18cd-4f35-a26b-f8c836f832d5'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.861979 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] The token cache is being invalidate because project 3f9686d8c3b74155a4427357a40dfdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:43:36.862373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.863219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-6de2142c-18cd-4f35-a26b-f8c836f832d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:43:36.865105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1312/2632] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:43:36 2022] DELETE /identity/v3/projects/3f9686d8c3b74155a4427357a40dfdb2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:43:36.871070 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7312b-f062-4cfc-84c7-31f72945eb86 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:36.871380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7312b-f062-4cfc-84c7-31f72945eb86 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:36.871655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7312b-f062-4cfc-84c7-31f72945eb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:36.888971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:43:36.902154 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-28a7312b-f062-4cfc-84c7-31f72945eb86 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:36.903405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-28a7312b-f062-4cfc-84c7-31f72945eb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:37.017827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1321/2633] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:37.044491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceed3e-158b-4ac3-9374-48fe4a7ed826 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.045644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceed3e-158b-4ac3-9374-48fe4a7ed826 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.047564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dceed3e-158b-4ac3-9374-48fe4a7ed826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.124565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3dceed3e-158b-4ac3-9374-48fe4a7ed826 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:37.124879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3dceed3e-158b-4ac3-9374-48fe4a7ed826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:37.134776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1313/2634] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:37.139739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7312b-f062-4cfc-84c7-31f72945eb86 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:37.151454 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7312b-f062-4cfc-84c7-31f72945eb86 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:37.156915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:37.157540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.157823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.158102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.158825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:43:37.159135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:37.160791 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:37.174802 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1322/2635] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:43:37.179917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceed3e-158b-4ac3-9374-48fe4a7ed826 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:37.191262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dceed3e-158b-4ac3-9374-48fe4a7ed826 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:37.197522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:37.199936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.199936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.199936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.199936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:37.201661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:37.297757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1314/2636] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:43:37 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:43:37.302112 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:37.313078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977737-349d-48cf-84ed-11248da9407f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:37.378716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:37.379792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.380072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.380341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.381777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:37.383998 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:37.553228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1323/2637] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:43:37 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:43:37.557537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:37.569363 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbc2c5-0ef2-4079-8597-b0c2022791e6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:37.574669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:37.575288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.575601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.575922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.576577 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:37.578920 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:37.597381 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1315/2638] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:43:37.601913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:37.615776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1276df-df83-442e-b526-09c2e9627ba7 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:37.618143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a918a73-829c-4922-ab4c-62259c76bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:37.618817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918a73-829c-4922-ab4c-62259c76bb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.619100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918a73-829c-4922-ab4c-62259c76bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.619402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a918a73-829c-4922-ab4c-62259c76bb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.620056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a918a73-829c-4922-ab4c-62259c76bb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:37.621657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a918a73-829c-4922-ab4c-62259c76bb09 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:37.637786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1324/2639] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:43:37.639361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:37.650871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe4f1f-14bb-477b-914f-50f8775d0cf5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:37.659107 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:37.660009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.660355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.660700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] PATH_INFO: `/v3/projects/757d84dd09aa401782bc3cfeeffc1ede/users/e790386cb0b64961871a6473662734db/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.675794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:43:37.681329 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=757d84dd09aa401782bc3cfeeffc1ede, user_id=e790386cb0b64961871a6473662734db, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:37.684020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:37.830335 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1316/2640] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:43:37 2022] PUT /identity/v3/projects/757d84dd09aa401782bc3cfeeffc1ede/users/e790386cb0b64961871a6473662734db/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:43:37.841667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fc62d-9ff2-4c7f-8f81-41970c7565ca None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:37.841961 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fc62d-9ff2-4c7f-8f81-41970c7565ca None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:37.842236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fc62d-9ff2-4c7f-8f81-41970c7565ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:37.872778 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2d3fc62d-9ff2-4c7f-8f81-41970c7565ca None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:37.874011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2d3fc62d-9ff2-4c7f-8f81-41970c7565ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:37.983632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1325/2641] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:43:37.989589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:37.992163 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:38.087896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d41794-e8c4-4e11-9afa-8d683d7538f6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:38.097554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:38.097554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:38.097554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:38.097554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:38.114236 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:38.117922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:38.129311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1317/2642] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:43:43.911056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3924fc-aa42-4202-b866-7f54a2499ae8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:43.911700 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3924fc-aa42-4202-b866-7f54a2499ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:43.912143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3924fc-aa42-4202-b866-7f54a2499ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:43.933635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:43:43.941865 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8d3924fc-aa42-4202-b866-7f54a2499ae8 None None] MFA Rules not processed for user `e790386cb0b64961871a6473662734db`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:43.947493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8d3924fc-aa42-4202-b866-7f54a2499ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:44.012674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1326/2643] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:43:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:44.029117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:44.030554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:44.123998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf6850-811c-4d24-9b60-37ec48fdd5eb service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:44.131866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e17d24-5067-44c2-9fbe-30e0f2d7d51a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:44.132491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17d24-5067-44c2-9fbe-30e0f2d7d51a service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:44.132775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17d24-5067-44c2-9fbe-30e0f2d7d51a service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:44.133043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e17d24-5067-44c2-9fbe-30e0f2d7d51a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:44.142021 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e17d24-5067-44c2-9fbe-30e0f2d7d51a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:44.143647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e17d24-5067-44c2-9fbe-30e0f2d7d51a service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:44.154356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1318/2644] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:43:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:43:47.478223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:47.478725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:47.478831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:47.499290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] MFA Rules not processed for user `e790386cb0b64961871a6473662734db`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:47.504285 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:47.509407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1327/2645] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:43:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:51.577112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:51.577590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:51.577702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:51.597523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] MFA Rules not processed for user `eb9b8e4dd597472699dc3c724c4464a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:43:51.598721 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:51.656418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1319/2646] 10.222.0.49 () {58 vars in 967 bytes} [Mon Sep 26 12:43:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:43:51.669653 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:43:51.671075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:43:51.739356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe171f92-ec37-4e56-9f66-3a8fb3c3172f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:43:51.744371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b99893144ac74cc9aec6d197c3dc1bc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:43:51.745041 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:43:51.745323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:43:51.745592 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:43:51.753539 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:43:51.755099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:43:51.763519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1328/2647] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Sep 26 12:43:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 12:44:01.648871 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:44:01.760535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=62 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:44:50.152549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:44:50.154692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:44:50.167218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc011f6-16e3-4086-bb5b-89907a98b74e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:44:50.171589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:44:50.172320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:44:50.172604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:44:50.172878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:44:50.174742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:44:50.190101 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:44:50.191589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:44:50.203775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1320/2648] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:44:51.400059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:44:51.410704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c337e1-9d59-435b-bd00-b8436c55072c service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:44:51.414467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:44:51.415072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:44:51.415367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:44:51.415641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:44:51.417422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:44:51.431914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:44:51.433346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:44:51.444694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1329/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:44:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:44:58.599140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:44:58.607876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201b738-4b5e-4266-83c1-10acaa36338a service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:44:58.612145 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:44:58.612750 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:44:58.613014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:44:58.613288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:44:58.615262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:44:58.627960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:44:58.629380 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:44:58.639472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1321/2650] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:01.439645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=6 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:02.377193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:02.378666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:02.393914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2682af-ac97-417e-8b36-291dd2b8c411 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:02.398502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:02.399111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:02.399416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:02.399689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] PATH_INFO: `/v3/users/442a196ea29942b682a170dc9b7ef607` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:02.414284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=442a196ea29942b682a170dc9b7ef607)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:02.416223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:02.734421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442a196ea29942b682a170dc9b7ef607'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:02.735782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442a196ea29942b682a170dc9b7ef607'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:02.744061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442a196ea29942b682a170dc9b7ef607'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:02.756875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442a196ea29942b682a170dc9b7ef607'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:02.845167 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-873b7772-77a9-4d50-a19c-73520f82c47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442a196ea29942b682a170dc9b7ef607'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:02.851875 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1330/2651] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:02 2022] DELETE /identity/v3/users/442a196ea29942b682a170dc9b7ef607 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:03.134079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:03.144182 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3cf2d-241f-4b4d-b948-2b970cbc9010 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:03.205320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:03.205960 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.206267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.206568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] PATH_INFO: `/v3/projects/16a6f180f0824880b73d35576a62be15` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:03.217355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a6f180f0824880b73d35576a62be15)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:03.221409 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:03.377962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a6f180f0824880b73d35576a62be15', 'request_id': 'req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:03.456321 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a6f180f0824880b73d35576a62be15', 'request_id': 'req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:03.462851 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a6f180f0824880b73d35576a62be15', 'request_id': 'req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:03.475468 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] The token cache is being invalidate because project 16a6f180f0824880b73d35576a62be15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:03.475759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:03.476414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-49e784c5-ed5c-40c3-bc9a-672e87c4c0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:03.477911 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1322/2652] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:03 2022] DELETE /identity/v3/projects/16a6f180f0824880b73d35576a62be15 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:03.482937 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675fdcf-c0d0-4a8d-8b8f-36e8ff2a6bd9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.483228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675fdcf-c0d0-4a8d-8b8f-36e8ff2a6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.483589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675fdcf-c0d0-4a8d-8b8f-36e8ff2a6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:03.504027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c675fdcf-c0d0-4a8d-8b8f-36e8ff2a6bd9 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:03.505238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c675fdcf-c0d0-4a8d-8b8f-36e8ff2a6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:03.565095 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1331/2653] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:03.573067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77001-ef98-4aec-bfcf-cf74733211c0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.573348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77001-ef98-4aec-bfcf-cf74733211c0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.573628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e77001-ef98-4aec-bfcf-cf74733211c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:03.593455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a4e77001-ef98-4aec-bfcf-cf74733211c0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:03.595268 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a4e77001-ef98-4aec-bfcf-cf74733211c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:03.603128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1323/2654] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:03.607765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675fdcf-c0d0-4a8d-8b8f-36e8ff2a6bd9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:03.618670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675fdcf-c0d0-4a8d-8b8f-36e8ff2a6bd9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:03.623442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:03.624042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.624319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.624591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:03.625328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:45:03.625596 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:03.627179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:03.639404 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1332/2655] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:45:03.644491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e77001-ef98-4aec-bfcf-cf74733211c0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:03.654017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e77001-ef98-4aec-bfcf-cf74733211c0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:03.659284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:03.659881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.660156 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.660446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:03.661091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:03.662968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:03.755631 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1324/2656] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:03 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:03.760353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:03.771229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be2bec-e2cc-4833-acf9-9e7a262afd23 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:03.818483 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:03.830349 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:03.830950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.831233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.831546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:03.832188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:03.834117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:03.937218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1333/2657] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:03 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:03.942151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:03.957674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0d1fa-e907-4ba0-8f87-35a8f6cc304f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:03.962973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:03.963624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.963906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.964177 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:03.964829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:03.966509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:03.977728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1325/2658] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:45:03.981860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:03.993448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488353-be0e-4319-822c-e62f8985d756 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:03.998216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e15dd-b048-476d-917a-ddcf75f0b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:03.998836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e15dd-b048-476d-917a-ddcf75f0b631 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:03.999133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e15dd-b048-476d-917a-ddcf75f0b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:03.999438 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e15dd-b048-476d-917a-ddcf75f0b631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.000754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e15dd-b048-476d-917a-ddcf75f0b631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.002447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e15dd-b048-476d-917a-ddcf75f0b631 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.015283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1334/2659] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:04.019369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:04.029513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c89383-2e61-461c-af3b-f6f89ea6baaf admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:04.034316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:04.034974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.035249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.035628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] PATH_INFO: `/v3/projects/f9373239c54c43569de97a7898c95d9f/users/03850a55a4384ad6bb086b114fa8aa25/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.037927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:04.051702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9373239c54c43569de97a7898c95d9f, user_id=03850a55a4384ad6bb086b114fa8aa25, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.054767 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.154067 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1326/2660] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:04 2022] PUT /identity/v3/projects/f9373239c54c43569de97a7898c95d9f/users/03850a55a4384ad6bb086b114fa8aa25/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:04.166062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249dad9-5694-4a1b-a159-67b371c78c83 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.166348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249dad9-5694-4a1b-a159-67b371c78c83 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.166621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249dad9-5694-4a1b-a159-67b371c78c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.196713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2249dad9-5694-4a1b-a159-67b371c78c83 None None] MFA Rules not processed for user `03850a55a4384ad6bb086b114fa8aa25`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:04.197912 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2249dad9-5694-4a1b-a159-67b371c78c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:04.272973 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1335/2661] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:04.277584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:04.341175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd027c2-2f08-413b-a3c5-00ed647f3e79 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:04.346622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:04.347214 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.347525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.347796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.348418 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.350304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.480617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1327/2662] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:04 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:04.485394 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249dad9-5694-4a1b-a159-67b371c78c83 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:04.496179 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249dad9-5694-4a1b-a159-67b371c78c83 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:04.557647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:04.558274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.558559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.558824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.559496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.561453 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.679419 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1336/2663] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:04 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:04.683527 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:04.693964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140516cc-af14-40b9-ac81-f4cfe4b32a79 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:04.698487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:04.699079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.699379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.699986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.700715 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.702307 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.713762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1328/2664] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:04.722079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:04.732073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d59233-6285-4781-906b-12309a5dc279 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:04.736787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:04.737445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.737720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.737993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] PATH_INFO: `/v3/projects/d9fdb7a90fb542ff80b9c3ce0c7c884e/users/7f20f2eca05a47dabb151f9036ab2f04/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.752734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fdb7a90fb542ff80b9c3ce0c7c884e, user_id=7f20f2eca05a47dabb151f9036ab2f04, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.755364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.845387 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1337/2665] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:04 2022] PUT /identity/v3/projects/d9fdb7a90fb542ff80b9c3ce0c7c884e/users/7f20f2eca05a47dabb151f9036ab2f04/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:04.849457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:04.860478 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7f068-7129-4d48-b441-6b649b7cf82c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:04.923537 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2e831-7bda-41a5-b00f-f13b38480c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:04.924098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2e831-7bda-41a5-b00f-f13b38480c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.924369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2e831-7bda-41a5-b00f-f13b38480c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.924633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2e831-7bda-41a5-b00f-f13b38480c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.925275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2e831-7bda-41a5-b00f-f13b38480c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.926882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2e831-7bda-41a5-b00f-f13b38480c67 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.936938 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1329/2666] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:04.941294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:04.951610 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd146a5-e94c-42ff-94ca-c7bfa86a1800 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:04.956354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:04.957033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.957309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.957579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] PATH_INFO: `/v3/projects/d9fdb7a90fb542ff80b9c3ce0c7c884e/users/7f20f2eca05a47dabb151f9036ab2f04/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:04.959532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fdb7a90fb542ff80b9c3ce0c7c884e, user_id=7f20f2eca05a47dabb151f9036ab2f04, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:04.962505 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:04.973765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1338/2667] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:04 2022] PUT /identity/v3/projects/d9fdb7a90fb542ff80b9c3ce0c7c884e/users/7f20f2eca05a47dabb151f9036ab2f04/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:45:04.983969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7554d15-2ba2-4a20-a1a6-f8df3ca7619f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:04.984186 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7554d15-2ba2-4a20-a1a6-f8df3ca7619f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:04.984494 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7554d15-2ba2-4a20-a1a6-f8df3ca7619f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:05.013230 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e7554d15-2ba2-4a20-a1a6-f8df3ca7619f None None] MFA Rules not processed for user `7f20f2eca05a47dabb151f9036ab2f04`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:05.014458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e7554d15-2ba2-4a20-a1a6-f8df3ca7619f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:05.057949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:05.085105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1330/2668] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:05.096657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:05.098340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:05.111854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:05.180349 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe76e-b64e-4133-9d30-aed22d242e20 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:05.184679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cd746-6a79-4858-8e4e-a77b3e8cb0e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:05.185281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cd746-6a79-4858-8e4e-a77b3e8cb0e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:05.185562 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cd746-6a79-4858-8e4e-a77b3e8cb0e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:05.186101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cd746-6a79-4858-8e4e-a77b3e8cb0e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:05.196316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cd746-6a79-4858-8e4e-a77b3e8cb0e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:05.197777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cd746-6a79-4858-8e4e-a77b3e8cb0e9 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:05.208111 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1339/2669] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:05.237482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7554d15-2ba2-4a20-a1a6-f8df3ca7619f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:05.301262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7554d15-2ba2-4a20-a1a6-f8df3ca7619f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:05.305776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:05.306400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:05.306677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:05.306968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] PATH_INFO: `/v3/users/03850a55a4384ad6bb086b114fa8aa25` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:05.308105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=03850a55a4384ad6bb086b114fa8aa25)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:05.309989 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:05.527641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03850a55a4384ad6bb086b114fa8aa25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:05.610947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03850a55a4384ad6bb086b114fa8aa25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:05.625951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03850a55a4384ad6bb086b114fa8aa25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:05.626835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03850a55a4384ad6bb086b114fa8aa25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:05.634243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03850a55a4384ad6bb086b114fa8aa25'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:05.640867 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1331/2670] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:05 2022] DELETE /identity/v3/users/03850a55a4384ad6bb086b114fa8aa25 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:05.645426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:05.645711 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:05.645988 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:05.665424 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:05.666631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:05.725265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1340/2671] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:05.735916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:05.737397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:05.796366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7eb9d-d90c-4162-a676-638315faef2d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:05.800607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:05.801216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:05.801493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:05.801768 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:05.812005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:05.813736 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:05.818991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:05.823985 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1332/2672] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:06.316165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:06.317636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:06.331609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaef92-57e0-4c38-b5f6-22930b22ceeb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:06.336417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:06.337047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:06.337332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:06.337598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] PATH_INFO: `/v3/projects/f9373239c54c43569de97a7898c95d9f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:06.338718 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9373239c54c43569de97a7898c95d9f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:06.340686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:06.456938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9373239c54c43569de97a7898c95d9f', 'request_id': 'req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.530335 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9373239c54c43569de97a7898c95d9f', 'request_id': 'req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.537160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9373239c54c43569de97a7898c95d9f', 'request_id': 'req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.549102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] The token cache is being invalidate because project f9373239c54c43569de97a7898c95d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:06.549390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.550026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.551648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1341/2673] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:06 2022] DELETE /identity/v3/projects/f9373239c54c43569de97a7898c95d9f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:06.555665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:06.566843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737c712-0a8f-4c9a-be9a-fdd91c84cc9e service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:06.624536 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:06.625256 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:06.625534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:06.625961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] PATH_INFO: `/v3/users/7f20f2eca05a47dabb151f9036ab2f04` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:06.627011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f20f2eca05a47dabb151f9036ab2f04)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:06.629028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:06.808061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f20f2eca05a47dabb151f9036ab2f04'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.896794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f20f2eca05a47dabb151f9036ab2f04'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.950538 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f20f2eca05a47dabb151f9036ab2f04'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.951289 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f20f2eca05a47dabb151f9036ab2f04'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.959394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-8a0538d6-5c5e-40e5-8d95-b8d4fa3f0ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f20f2eca05a47dabb151f9036ab2f04'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:06.965836 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1333/2674] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:06 2022] DELETE /identity/v3/users/7f20f2eca05a47dabb151f9036ab2f04 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:45:07.383215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:07.385157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:07.398544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2aa3f-996f-4bf8-9ff2-3d1d82f1c114 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:07.411578 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:07.457120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:07.457550 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:07.457846 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:07.458116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] PATH_INFO: `/v3/projects/d9fdb7a90fb542ff80b9c3ce0c7c884e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:07.459229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fdb7a90fb542ff80b9c3ce0c7c884e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:07.461237 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:07.647444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fdb7a90fb542ff80b9c3ce0c7c884e', 'request_id': 'req-53f22475-565f-4434-a853-210a8a48ca13'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:07.735892 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fdb7a90fb542ff80b9c3ce0c7c884e', 'request_id': 'req-53f22475-565f-4434-a853-210a8a48ca13'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:07.742292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fdb7a90fb542ff80b9c3ce0c7c884e', 'request_id': 'req-53f22475-565f-4434-a853-210a8a48ca13'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:07.754642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] The token cache is being invalidate because project d9fdb7a90fb542ff80b9c3ce0c7c884e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:07.754967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:07.755660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-53f22475-565f-4434-a853-210a8a48ca13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:07.757165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1342/2675] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:07 2022] DELETE /identity/v3/projects/d9fdb7a90fb542ff80b9c3ce0c7c884e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:07.762498 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575bc7-24a2-485b-8535-723f3195ca2a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:07.763037 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575bc7-24a2-485b-8535-723f3195ca2a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:07.763161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80575bc7-24a2-485b-8535-723f3195ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:07.787789 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-80575bc7-24a2-485b-8535-723f3195ca2a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:07.789020 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-80575bc7-24a2-485b-8535-723f3195ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:07.850053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1334/2676] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:07.857932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827083f-02c0-49b2-8084-ecbb9b25501a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:07.858223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827083f-02c0-49b2-8084-ecbb9b25501a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:07.858501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827083f-02c0-49b2-8084-ecbb9b25501a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:07.880181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d827083f-02c0-49b2-8084-ecbb9b25501a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:07.885611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d827083f-02c0-49b2-8084-ecbb9b25501a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:07.895703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1343/2677] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:07.900684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575bc7-24a2-485b-8535-723f3195ca2a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:07.910615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80575bc7-24a2-485b-8535-723f3195ca2a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:07.915496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:07.916096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:07.916374 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:07.916644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:07.917290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:45:07.917696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:07.919184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:07.931808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1335/2678] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:45:07.936529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827083f-02c0-49b2-8084-ecbb9b25501a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:07.946593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827083f-02c0-49b2-8084-ecbb9b25501a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:07.951312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:07.951946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:07.952227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:07.952508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:07.953145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:07.955042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:08.144007 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1344/2679] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:07 2022] POST /identity/v3/projects => generated 401 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:08.148352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:08.158444 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342aa72f-0fba-4409-98c5-15d66e25bf33 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:08.162860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:08.218141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:08.218753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:08.219035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:08.219382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:08.220028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:08.222663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:08.365703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1336/2680] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:08 2022] POST /identity/v3/users => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:08.370270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:08.380809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e715b5-dc3a-451e-98f9-f1a9ffad08d9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:08.385734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:08.386323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:08.386599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:08.386869 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:08.387549 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:08.389143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:08.401270 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1345/2681] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:08.405617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:08.416661 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad744e7-d0d4-4411-94f0-b09366f2809d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:08.421505 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50345c4-cb31-4324-b05c-9fd76c779097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:08.422106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50345c4-cb31-4324-b05c-9fd76c779097 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:08.422382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50345c4-cb31-4324-b05c-9fd76c779097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:08.422652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50345c4-cb31-4324-b05c-9fd76c779097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:08.423287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50345c4-cb31-4324-b05c-9fd76c779097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:08.424894 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50345c4-cb31-4324-b05c-9fd76c779097 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:08.434945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1337/2682] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:08.439677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:08.450985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a65a2-8dbd-436d-aac1-852d76f4fb78 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:08.455627 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:08.457255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:08.457538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:08.457817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] PATH_INFO: `/v3/projects/6800b49bbc7441d3b1f946ebb68a1387/users/e4b771dd45ff4d94b0c59947156a7c9d/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:08.474145 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6800b49bbc7441d3b1f946ebb68a1387, user_id=e4b771dd45ff4d94b0c59947156a7c9d, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:08.476870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:08.587819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1346/2683] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:08 2022] PUT /identity/v3/projects/6800b49bbc7441d3b1f946ebb68a1387/users/e4b771dd45ff4d94b0c59947156a7c9d/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:45:08.601068 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885048-6375-4ea3-9e48-aae274637013 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:08.601461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885048-6375-4ea3-9e48-aae274637013 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:08.601673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885048-6375-4ea3-9e48-aae274637013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:08.633290 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-74885048-6375-4ea3-9e48-aae274637013 None None] MFA Rules not processed for user `e4b771dd45ff4d94b0c59947156a7c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:08.634435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-74885048-6375-4ea3-9e48-aae274637013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:08.704058 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1338/2684] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:08.709224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:08.764822 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:08.782722 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264079-f223-4607-b738-79eb45b3e931 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:08.788367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:08.788981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:08.789258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:08.789527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:08.790178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:08.792312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:08.944680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1347/2685] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:08 2022] POST /identity/v3/projects => generated 399 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:08.949027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885048-6375-4ea3-9e48-aae274637013 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:08.964181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885048-6375-4ea3-9e48-aae274637013 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:09.024170 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:09.024788 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.025074 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.025350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.025986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:09.028003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:09.165855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1339/2686] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:08 2022] POST /identity/v3/users => generated 306 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:09.169979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:09.180575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c863db-5bd3-4ef3-bdab-b6766ac1a740 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:09.185642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:09.186238 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.186514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.186788 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.187910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:09.189073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:09.199827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1348/2687] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:45:09.204013 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:09.211375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:09.215432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808d423-16f9-422e-9fbb-8aea50e2f8d3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:09.220162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:09.225387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.225387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.225387 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] PATH_INFO: `/v3/projects/ddfb7cc2d7ee46cab6f5a35c2cac1c9d/users/24adbc32efe3479f93874c294e89bfa3/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.239744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfb7cc2d7ee46cab6f5a35c2cac1c9d, user_id=24adbc32efe3479f93874c294e89bfa3, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:09.242415 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:09.329916 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1340/2688] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:09 2022] PUT /identity/v3/projects/ddfb7cc2d7ee46cab6f5a35c2cac1c9d/users/24adbc32efe3479f93874c294e89bfa3/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:09.338032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:09.348748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebb291-1588-498b-954f-399c5fc5c4c0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:09.403765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ca0f-8f90-4eb8-9527-98f2a508d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:09.404458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ca0f-8f90-4eb8-9527-98f2a508d7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.404623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ca0f-8f90-4eb8-9527-98f2a508d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.404890 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ca0f-8f90-4eb8-9527-98f2a508d7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.405527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ca0f-8f90-4eb8-9527-98f2a508d7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:09.407100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ca0f-8f90-4eb8-9527-98f2a508d7ff admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:09.417531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1349/2689] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:09.421749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:09.433295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f46633-544f-4616-8222-d9d916d71dc0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:09.438102 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:09.438763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.439043 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.439320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] PATH_INFO: `/v3/projects/ddfb7cc2d7ee46cab6f5a35c2cac1c9d/users/24adbc32efe3479f93874c294e89bfa3/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.441616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfb7cc2d7ee46cab6f5a35c2cac1c9d, user_id=24adbc32efe3479f93874c294e89bfa3, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:09.444328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:09.455180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1341/2690] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:09 2022] PUT /identity/v3/projects/ddfb7cc2d7ee46cab6f5a35c2cac1c9d/users/24adbc32efe3479f93874c294e89bfa3/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:09.465843 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4e01-7856-451f-a578-2f28adfdd54e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.466130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4e01-7856-451f-a578-2f28adfdd54e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.466402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4e01-7856-451f-a578-2f28adfdd54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.499391 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2e5a4e01-7856-451f-a578-2f28adfdd54e None None] MFA Rules not processed for user `24adbc32efe3479f93874c294e89bfa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:09.501346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2e5a4e01-7856-451f-a578-2f28adfdd54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:09.569039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1350/2691] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:09.579803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:09.581567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:09.640159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086f86-69f1-4a7e-b958-832741928089 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:09.643903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:09.644499 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.644803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.645077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.654273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:09.655730 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:09.666299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1342/2692] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:09.871399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4e01-7856-451f-a578-2f28adfdd54e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:09.881511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4e01-7856-451f-a578-2f28adfdd54e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:09.885344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690debaa-7313-445b-af56-2931b532a400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:09.885939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690debaa-7313-445b-af56-2931b532a400 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:09.886216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690debaa-7313-445b-af56-2931b532a400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:09.886487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690debaa-7313-445b-af56-2931b532a400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:09.921069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:09.944363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690debaa-7313-445b-af56-2931b532a400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:09.945833 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690debaa-7313-445b-af56-2931b532a400 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:09.954941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1351/2693] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:09 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:16.365003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:16.439717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80dd76-0966-4324-ae97-501d764112e0 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:16.445165 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:16.445796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:16.446077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:16.446371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] PATH_INFO: `/v3/users/e4b771dd45ff4d94b0c59947156a7c9d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:16.447519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b771dd45ff4d94b0c59947156a7c9d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:16.449442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:16.658063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b771dd45ff4d94b0c59947156a7c9d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:16.753148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b771dd45ff4d94b0c59947156a7c9d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:16.767800 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b771dd45ff4d94b0c59947156a7c9d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:16.768578 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b771dd45ff4d94b0c59947156a7c9d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:16.769855 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:16.776284 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b771dd45ff4d94b0c59947156a7c9d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:16.790809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1343/2694] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:16 2022] DELETE /identity/v3/users/e4b771dd45ff4d94b0c59947156a7c9d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:16.790976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:16.790976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:16.790976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:16.809427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:16.810663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:16.874755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1352/2695] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:16.885408 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:16.886877 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:16.949490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc11684-e937-43aa-abaa-a91a501b6b70 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:16.954129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:16.954795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:16.955115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:16.955472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:16.965520 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:16.966958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:16.977738 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1344/2696] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:17.395299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:17.396885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:17.410414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9815d-9d3a-4d52-a49b-e753fa4e418b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:17.415200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:17.415916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:17.421092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:17.421092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] PATH_INFO: `/v3/projects/6800b49bbc7441d3b1f946ebb68a1387` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:17.421092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6800b49bbc7441d3b1f946ebb68a1387)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:17.421092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:17.541878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6800b49bbc7441d3b1f946ebb68a1387', 'request_id': 'req-d692bca4-386d-450a-9e5f-bff913576e6d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:17.620857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6800b49bbc7441d3b1f946ebb68a1387', 'request_id': 'req-d692bca4-386d-450a-9e5f-bff913576e6d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:17.627020 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6800b49bbc7441d3b1f946ebb68a1387', 'request_id': 'req-d692bca4-386d-450a-9e5f-bff913576e6d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:17.640077 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] The token cache is being invalidate because project 6800b49bbc7441d3b1f946ebb68a1387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:17.640311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:17.640940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:17.642476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1353/2697] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:17 2022] DELETE /identity/v3/projects/6800b49bbc7441d3b1f946ebb68a1387 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:17.647532 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:17.657000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f645e88-6b27-4c09-b04e-89bf84cf1d1f service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:17.717914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:17.718469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:17.718746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:17.719014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] PATH_INFO: `/v3/users/24adbc32efe3479f93874c294e89bfa3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:17.720167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24adbc32efe3479f93874c294e89bfa3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:17.722075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:17.968823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24adbc32efe3479f93874c294e89bfa3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.027367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24adbc32efe3479f93874c294e89bfa3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.041304 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24adbc32efe3479f93874c294e89bfa3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.042055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24adbc32efe3479f93874c294e89bfa3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.053299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f37c51de-f09e-4c19-b666-07bfb631ea15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24adbc32efe3479f93874c294e89bfa3'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.059975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1345/2698] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:17 2022] DELETE /identity/v3/users/24adbc32efe3479f93874c294e89bfa3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:18.509734 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:18.511553 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:18.525820 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692bca4-386d-450a-9e5f-bff913576e6d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:18.590383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:18.591020 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:18.591302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:18.591612 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] PATH_INFO: `/v3/projects/ddfb7cc2d7ee46cab6f5a35c2cac1c9d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:18.592752 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfb7cc2d7ee46cab6f5a35c2cac1c9d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:18.594647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:18.596182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:18.732576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfb7cc2d7ee46cab6f5a35c2cac1c9d', 'request_id': 'req-dbc26167-97a1-4164-b499-5283ccd8f933'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.821845 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfb7cc2d7ee46cab6f5a35c2cac1c9d', 'request_id': 'req-dbc26167-97a1-4164-b499-5283ccd8f933'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.829333 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfb7cc2d7ee46cab6f5a35c2cac1c9d', 'request_id': 'req-dbc26167-97a1-4164-b499-5283ccd8f933'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.841883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] The token cache is being invalidate because project ddfb7cc2d7ee46cab6f5a35c2cac1c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:18.842184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.842868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-dbc26167-97a1-4164-b499-5283ccd8f933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:18.844444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1354/2699] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:18 2022] DELETE /identity/v3/projects/ddfb7cc2d7ee46cab6f5a35c2cac1c9d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:18.849709 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb9dc2-28a8-4ee3-9d43-68d85d205ea8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:18.850272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb9dc2-28a8-4ee3-9d43-68d85d205ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:18.850272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb9dc2-28a8-4ee3-9d43-68d85d205ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:18.871942 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f4cb9dc2-28a8-4ee3-9d43-68d85d205ea8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:18.873178 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f4cb9dc2-28a8-4ee3-9d43-68d85d205ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:18.880457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:18.938065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1346/2700] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:18.947517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e9b7-e1ce-4057-81ac-a2f45c088d75 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:18.947800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e9b7-e1ce-4057-81ac-a2f45c088d75 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:18.948067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925e9b7-e1ce-4057-81ac-a2f45c088d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:18.968147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4925e9b7-e1ce-4057-81ac-a2f45c088d75 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:18.969311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4925e9b7-e1ce-4057-81ac-a2f45c088d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:18.977501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1355/2701] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:18.982002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb9dc2-28a8-4ee3-9d43-68d85d205ea8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:18.992245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb9dc2-28a8-4ee3-9d43-68d85d205ea8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:18.996776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:18.997367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:18.997641 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:18.997906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:18.998540 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:45:18.998840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.000442 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.012860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1347/2702] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:45:19.017283 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e9b7-e1ce-4057-81ac-a2f45c088d75 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:19.026585 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925e9b7-e1ce-4057-81ac-a2f45c088d75 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:19.031318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:19.031938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.032255 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.032528 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.033163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.035716 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.172099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1356/2703] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:19 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:19.177110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:19.187046 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35ed0d-7f3c-4059-bc8e-65d3ea869927 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:19.244708 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:19.245320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.245599 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.245868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.246506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.248447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.336874 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1348/2704] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:19 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:19.341008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:19.352444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfe23e-1b83-4f0b-b2f1-659f9e145da2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:19.357224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:19.357744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.358025 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.358297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.358946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.360708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.371689 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1357/2705] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:19.375817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:19.386354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cd741-f165-4f8a-b2c5-631f63925b68 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:19.391059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa1f55-f130-4f8d-a2e8-3f51e9b78c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:19.391692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa1f55-f130-4f8d-a2e8-3f51e9b78c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.391974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa1f55-f130-4f8d-a2e8-3f51e9b78c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.392274 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa1f55-f130-4f8d-a2e8-3f51e9b78c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.392918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa1f55-f130-4f8d-a2e8-3f51e9b78c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.395398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa1f55-f130-4f8d-a2e8-3f51e9b78c6c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.406192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1349/2706] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:45:19.411360 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:19.421633 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ef3bd-5d66-46ae-bca8-3d7346db85e2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:19.426710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:19.427301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.427606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.427877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] PATH_INFO: `/v3/projects/4e3dc9843a8b469f9a4d266e8f8848ff/users/331573e12b5849be8599b610e9f24ff8/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.442636 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3dc9843a8b469f9a4d266e8f8848ff, user_id=331573e12b5849be8599b610e9f24ff8, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.445304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.524388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1358/2707] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:19 2022] PUT /identity/v3/projects/4e3dc9843a8b469f9a4d266e8f8848ff/users/331573e12b5849be8599b610e9f24ff8/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:19.534626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b200045-72bb-493b-871f-3c00d333c89d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.535665 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b200045-72bb-493b-871f-3c00d333c89d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.535937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b200045-72bb-493b-871f-3c00d333c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.563565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7b200045-72bb-493b-871f-3c00d333c89d None None] MFA Rules not processed for user `331573e12b5849be8599b610e9f24ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:19.564774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7b200045-72bb-493b-871f-3c00d333c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:19.627770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1350/2708] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:19.632476 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:19.699523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05768cd9-b9f1-4f08-adc1-7a24fa5da0f6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:19.704146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:19.704744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.705026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.705296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.705941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.708737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.817826 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1359/2709] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:19 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:19.822124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b200045-72bb-493b-871f-3c00d333c89d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:19.834130 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b200045-72bb-493b-871f-3c00d333c89d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:19.837843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:19.891401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:19.892137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:19.892467 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:19.892692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:19.893331 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:19.896392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:19.987829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1351/2710] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:19 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:19.992568 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:20.005472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27f46c-8393-49db-96f0-3ec959916d13 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:20.011748 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:20.012402 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:20.012685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:20.012963 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:20.013617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:20.015242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:20.023666 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:20.031654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1360/2711] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:20.034350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:20.050392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc97b20-8f37-4717-8871-6e77035e8beb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:20.055727 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:20.056412 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:20.056698 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:20.057018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] PATH_INFO: `/v3/projects/3dcfdec686ed46f7a09ce448826e9883/users/11789505c519418a8cac7410120d5e2b/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:20.078649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcfdec686ed46f7a09ce448826e9883, user_id=11789505c519418a8cac7410120d5e2b, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:20.081396 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:20.172453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1352/2712] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:20 2022] PUT /identity/v3/projects/3dcfdec686ed46f7a09ce448826e9883/users/11789505c519418a8cac7410120d5e2b/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:20.177603 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:20.188341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c6013-8e96-44a9-845a-865b3aaeb0d0 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:20.246040 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac52783-cd1d-4417-9b79-081d9b27322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:20.246566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52783-cd1d-4417-9b79-081d9b27322c admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:20.246847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52783-cd1d-4417-9b79-081d9b27322c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:20.247121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52783-cd1d-4417-9b79-081d9b27322c admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:20.247803 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac52783-cd1d-4417-9b79-081d9b27322c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:20.249390 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac52783-cd1d-4417-9b79-081d9b27322c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:20.259589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1361/2713] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:20.264099 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:20.274882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5561f2-d2ad-46c4-b824-fcb715950e9e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:20.279753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:20.280423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:20.280707 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:20.281012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] PATH_INFO: `/v3/projects/3dcfdec686ed46f7a09ce448826e9883/users/11789505c519418a8cac7410120d5e2b/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:20.282948 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcfdec686ed46f7a09ce448826e9883, user_id=11789505c519418a8cac7410120d5e2b, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:20.285766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:20.296632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1353/2714] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:20 2022] PUT /identity/v3/projects/3dcfdec686ed46f7a09ce448826e9883/users/11789505c519418a8cac7410120d5e2b/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:20.311132 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab916-e9dc-446a-9e71-2c5bc2f75631 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:20.311521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab916-e9dc-446a-9e71-2c5bc2f75631 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:20.311800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bab916-e9dc-446a-9e71-2c5bc2f75631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:20.341586 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-82bab916-e9dc-446a-9e71-2c5bc2f75631 None None] MFA Rules not processed for user `11789505c519418a8cac7410120d5e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:20.342900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-82bab916-e9dc-446a-9e71-2c5bc2f75631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:20.413693 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1362/2715] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:45:20.426116 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:20.427900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:20.497633 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a26e-7800-495c-bd1e-e0762009060e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:20.501197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25583f-a1de-4557-ad4c-0cbf25f819dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:20.501794 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25583f-a1de-4557-ad4c-0cbf25f819dd service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:20.502069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25583f-a1de-4557-ad4c-0cbf25f819dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:20.502337 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25583f-a1de-4557-ad4c-0cbf25f819dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:20.512175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25583f-a1de-4557-ad4c-0cbf25f819dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:20.513589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25583f-a1de-4557-ad4c-0cbf25f819dd service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:20.524472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1354/2716] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:20.664242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab916-e9dc-446a-9e71-2c5bc2f75631 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:20.732253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bab916-e9dc-446a-9e71-2c5bc2f75631 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:20.738043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:20.738043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:20.738043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:20.738043 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] PATH_INFO: `/v3/users/331573e12b5849be8599b610e9f24ff8` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:20.739215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=331573e12b5849be8599b610e9f24ff8)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:20.741151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:20.772420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:20.978858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '331573e12b5849be8599b610e9f24ff8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:20.979557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '331573e12b5849be8599b610e9f24ff8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:20.986770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '331573e12b5849be8599b610e9f24ff8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:20.999331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '331573e12b5849be8599b610e9f24ff8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:21.089857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '331573e12b5849be8599b610e9f24ff8'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:21.096510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1363/2717] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:20 2022] DELETE /identity/v3/users/331573e12b5849be8599b610e9f24ff8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:21.105237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:21.105237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:21.105237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:21.120982 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:21.122183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:21.185003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1355/2718] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:21.195512 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:21.197075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:21.257125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde086c-ea5a-4bda-80e4-d3891a96f41a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:21.261101 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:21.261740 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:21.262015 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:21.262284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:21.271934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:21.273341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:21.283036 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1364/2719] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:21.748471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:21.750141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:21.760648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:21.766213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b7f4-c312-419e-a93b-10d1bd3d2371 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:21.771962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:21.772603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:21.773114 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:21.773354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] PATH_INFO: `/v3/projects/4e3dc9843a8b469f9a4d266e8f8848ff` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:21.775504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3dc9843a8b469f9a4d266e8f8848ff)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:21.778024 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:21.920815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3dc9843a8b469f9a4d266e8f8848ff', 'request_id': 'req-d3aad124-b37e-4320-b85a-bb152cd9940c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.011262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3dc9843a8b469f9a4d266e8f8848ff', 'request_id': 'req-d3aad124-b37e-4320-b85a-bb152cd9940c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.019592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3dc9843a8b469f9a4d266e8f8848ff', 'request_id': 'req-d3aad124-b37e-4320-b85a-bb152cd9940c'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.033622 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] The token cache is being invalidate because project 4e3dc9843a8b469f9a4d266e8f8848ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:22.033906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.034564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.036878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1356/2720] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:21 2022] DELETE /identity/v3/projects/4e3dc9843a8b469f9a4d266e8f8848ff => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:22.040872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:22.050807 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc0ad7-bade-4e92-8b5e-40a7967b4124 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:22.114683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:22.115309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:22.122314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:22.122314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] PATH_INFO: `/v3/users/11789505c519418a8cac7410120d5e2b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:22.122314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11789505c519418a8cac7410120d5e2b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:22.122314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:22.354785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:22.356465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11789505c519418a8cac7410120d5e2b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.357130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11789505c519418a8cac7410120d5e2b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.364941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11789505c519418a8cac7410120d5e2b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.377304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11789505c519418a8cac7410120d5e2b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.479209 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5165ad89-9c24-46ea-a59a-3300f7a0a149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11789505c519418a8cac7410120d5e2b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:22.493150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1365/2721] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:22 2022] DELETE /identity/v3/users/11789505c519418a8cac7410120d5e2b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:22.997175 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:22.997782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:23.018691 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aad124-b37e-4320-b85a-bb152cd9940c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:23.082221 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:23.100343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.100343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.100343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] PATH_INFO: `/v3/projects/3dcfdec686ed46f7a09ce448826e9883` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.100343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcfdec686ed46f7a09ce448826e9883)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:23.100343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:23.248316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcfdec686ed46f7a09ce448826e9883', 'request_id': 'req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:23.381686 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcfdec686ed46f7a09ce448826e9883', 'request_id': 'req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:23.388310 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcfdec686ed46f7a09ce448826e9883', 'request_id': 'req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:23.400461 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] The token cache is being invalidate because project 3dcfdec686ed46f7a09ce448826e9883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:23.400759 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:23.401416 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-dd32d1dc-5640-4e7d-8555-f7dcf65d5dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:23.402968 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1357/2722] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:22 2022] DELETE /identity/v3/projects/3dcfdec686ed46f7a09ce448826e9883 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:23.408176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7602-0b33-48d6-8d7e-dfdc6a7fef97 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.408801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7602-0b33-48d6-8d7e-dfdc6a7fef97 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.408801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7602-0b33-48d6-8d7e-dfdc6a7fef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.429561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-846f7602-0b33-48d6-8d7e-dfdc6a7fef97 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:23.430850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-846f7602-0b33-48d6-8d7e-dfdc6a7fef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:23.492312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1366/2723] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:23.501105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9b40c-3674-46f4-bec5-1f0d553f4786 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.501330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9b40c-3674-46f4-bec5-1f0d553f4786 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.501608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9b40c-3674-46f4-bec5-1f0d553f4786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.522122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8cc9b40c-3674-46f4-bec5-1f0d553f4786 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:23.523333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8cc9b40c-3674-46f4-bec5-1f0d553f4786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:23.541666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1358/2724] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:45:23.544292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7602-0b33-48d6-8d7e-dfdc6a7fef97 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:23.554254 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7602-0b33-48d6-8d7e-dfdc6a7fef97 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:23.559123 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:23.559781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.560075 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.560389 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.560997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:45:23.561296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:23.562874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:23.574900 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1367/2725] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:45:23.580523 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9b40c-3674-46f4-bec5-1f0d553f4786 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:23.590369 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9b40c-3674-46f4-bec5-1f0d553f4786 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:23.595267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:23.595895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.596169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.596437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.597065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:23.599726 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:23.605124 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:23.685594 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1359/2726] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:23 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:45:23.689801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:23.699968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460603-2b43-4a46-8485-3b8ae91c2fa1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:23.761510 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:23.761821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.762104 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.762412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.763034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:23.765109 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:23.862171 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1368/2727] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:23 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:23.866479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:23.877082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070728f1-db78-4f1b-9a21-47fd4dde5c5c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:23.882120 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:23.882858 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.883127 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.883424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.884075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:23.885994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:23.897185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1360/2728] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:45:23.901535 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:23.912406 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfc299-1229-4b35-b8fb-0e860dceaece admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:23.917062 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd227a-947a-44f9-87df-bc423f089758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:23.917654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd227a-947a-44f9-87df-bc423f089758 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.917929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd227a-947a-44f9-87df-bc423f089758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.918194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd227a-947a-44f9-87df-bc423f089758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.918874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd227a-947a-44f9-87df-bc423f089758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:23.920492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd227a-947a-44f9-87df-bc423f089758 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:23.931696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1369/2729] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:23.935809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:23.946560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3735f0-6b9b-4ddc-9e4b-b9617a62ddff admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:23.951480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:23.952136 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:23.952427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:23.952692 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] PATH_INFO: `/v3/projects/ce9cbd5807a24acd81321cb6b707d152/users/8eb4e75b3834498f93063f8bb64d23ef/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:23.969435 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9cbd5807a24acd81321cb6b707d152, user_id=8eb4e75b3834498f93063f8bb64d23ef, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:23.972151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:24.076446 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1361/2730] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:23 2022] PUT /identity/v3/projects/ce9cbd5807a24acd81321cb6b707d152/users/8eb4e75b3834498f93063f8bb64d23ef/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:24.087685 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5d76-2662-4e13-a02c-7d7fcada49a2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.087966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5d76-2662-4e13-a02c-7d7fcada49a2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.088236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a5d76-2662-4e13-a02c-7d7fcada49a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.117408 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-527a5d76-2662-4e13-a02c-7d7fcada49a2 None None] MFA Rules not processed for user `8eb4e75b3834498f93063f8bb64d23ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:24.118639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-527a5d76-2662-4e13-a02c-7d7fcada49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:24.139486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:24.188239 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1370/2731] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:24.193944 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:24.262134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9d599-b6af-462b-a663-854a82fdef8c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:24.266828 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:24.267455 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.267733 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.268001 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.268625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:24.271150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:24.348404 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1362/2732] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:24 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:24.353450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5d76-2662-4e13-a02c-7d7fcada49a2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:24.364818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a5d76-2662-4e13-a02c-7d7fcada49a2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:24.422896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:24.423651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.423813 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.424086 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.424733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:24.427165 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:24.593392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1371/2733] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:24 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:45:24.597611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:24.608213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6025cb-4d6f-4c48-8a18-a22f140cccba admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:24.612740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:24.613346 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.613625 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.613897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.615141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:24.616782 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:24.627273 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1363/2734] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:45:24.632422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:24.643081 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656ffcc-1b06-4870-97eb-eb9322a6168d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:24.647759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:24.650785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.650785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.650785 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] PATH_INFO: `/v3/projects/ec8633dfd4f64b78a1268f288cfd3704/users/c143a2dbe5aa42f38319398a23c7085b/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.665085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8633dfd4f64b78a1268f288cfd3704, user_id=c143a2dbe5aa42f38319398a23c7085b, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:24.667775 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:24.770625 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1372/2735] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:24 2022] PUT /identity/v3/projects/ec8633dfd4f64b78a1268f288cfd3704/users/c143a2dbe5aa42f38319398a23c7085b/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:24.774947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:24.785263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d05b-d152-43ea-a36e-42586a567262 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:24.844706 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebe80a-ca73-43bb-a4d5-d9b1e6c67d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:24.845330 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe80a-ca73-43bb-a4d5-d9b1e6c67d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.845607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe80a-ca73-43bb-a4d5-d9b1e6c67d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.845882 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe80a-ca73-43bb-a4d5-d9b1e6c67d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.846556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebe80a-ca73-43bb-a4d5-d9b1e6c67d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:24.848208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebe80a-ca73-43bb-a4d5-d9b1e6c67d3d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:24.862134 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1364/2736] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:24.863231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:24.874517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de941434-e8a7-4249-87a2-04ba5b364b1a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:24.882914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:24.889096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.889096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.889096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] PATH_INFO: `/v3/projects/ec8633dfd4f64b78a1268f288cfd3704/users/c143a2dbe5aa42f38319398a23c7085b/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.889096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8633dfd4f64b78a1268f288cfd3704, user_id=c143a2dbe5aa42f38319398a23c7085b, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:24.889096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:24.900831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1373/2737] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:24 2022] PUT /identity/v3/projects/ec8633dfd4f64b78a1268f288cfd3704/users/c143a2dbe5aa42f38319398a23c7085b/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:24.912716 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdeb76-87cd-4eae-bf0e-f916277ae3c8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:24.913006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdeb76-87cd-4eae-bf0e-f916277ae3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:24.913291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdeb76-87cd-4eae-bf0e-f916277ae3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:24.944370 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5bfdeb76-87cd-4eae-bf0e-f916277ae3c8 None None] MFA Rules not processed for user `c143a2dbe5aa42f38319398a23c7085b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:24.945604 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5bfdeb76-87cd-4eae-bf0e-f916277ae3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:24.955737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:25.022772 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1365/2738] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:25.034328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:25.036934 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:25.103551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd07af-0fc1-496f-b283-07a493c35e52 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:25.107804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:25.108417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:25.108687 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:25.108955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:25.120307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:25.120307 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:25.129606 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1374/2739] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:25.282432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdeb76-87cd-4eae-bf0e-f916277ae3c8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:25.292918 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdeb76-87cd-4eae-bf0e-f916277ae3c8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:25.296898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36699-8e72-486a-9d5f-721448e0f34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:25.297504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36699-8e72-486a-9d5f-721448e0f34a service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:25.297781 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36699-8e72-486a-9d5f-721448e0f34a service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:25.298053 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36699-8e72-486a-9d5f-721448e0f34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:25.358308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36699-8e72-486a-9d5f-721448e0f34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:25.359624 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36699-8e72-486a-9d5f-721448e0f34a service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:25.369395 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1366/2740] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:25.843425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:25.860140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:25.913398 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e94444-e103-40fc-a7b9-c309e6c598d3 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:25.918178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:25.918974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:25.919162 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:25.919331 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] PATH_INFO: `/v3/users/8eb4e75b3834498f93063f8bb64d23ef` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:25.920531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb4e75b3834498f93063f8bb64d23ef)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:25.922548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:26.197011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb4e75b3834498f93063f8bb64d23ef'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:26.197733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb4e75b3834498f93063f8bb64d23ef'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:26.205621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb4e75b3834498f93063f8bb64d23ef'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:26.223487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb4e75b3834498f93063f8bb64d23ef'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:26.301079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb4e75b3834498f93063f8bb64d23ef'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:26.307683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1375/2741] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:25 2022] DELETE /identity/v3/users/8eb4e75b3834498f93063f8bb64d23ef => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:26.312573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:26.313098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:26.313098 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:26.332451 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:26.337587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:26.396937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1367/2742] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:45:26.407508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:26.410160 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:26.470678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef911b1f-c07b-492c-96a0-a1cb4e925e0d admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:26.474638 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:26.475251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:26.475563 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:26.475838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:26.485157 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:26.486580 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:26.497064 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1376/2743] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:27.161511 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:27.162813 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:27.177573 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafa191-2148-4ad6-8797-4f579c90248a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:27.183153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:27.183857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:27.184585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:27.184585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] PATH_INFO: `/v3/projects/ce9cbd5807a24acd81321cb6b707d152` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:27.185717 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9cbd5807a24acd81321cb6b707d152)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:27.187863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:27.365549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:27.372197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9cbd5807a24acd81321cb6b707d152', 'request_id': 'req-f3cac1ce-914f-4391-858c-c514790dcfdb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.478675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9cbd5807a24acd81321cb6b707d152', 'request_id': 'req-f3cac1ce-914f-4391-858c-c514790dcfdb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.484888 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9cbd5807a24acd81321cb6b707d152', 'request_id': 'req-f3cac1ce-914f-4391-858c-c514790dcfdb'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.497693 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] The token cache is being invalidate because project ce9cbd5807a24acd81321cb6b707d152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:27.499843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.499843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-f3cac1ce-914f-4391-858c-c514790dcfdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.500292 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1368/2744] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:27 2022] DELETE /identity/v3/projects/ce9cbd5807a24acd81321cb6b707d152 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:27.504231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:27.514276 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e974221-4953-4b4c-952a-ce9fa9d5353e service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:27.547879 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:27.571847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:27.574341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:27.574341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:27.574341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] PATH_INFO: `/v3/users/c143a2dbe5aa42f38319398a23c7085b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:27.574341 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c143a2dbe5aa42f38319398a23c7085b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:27.576031 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:27.811803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:27.812092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:27.812371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:27.832514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] MFA Rules not processed for user `e790386cb0b64961871a6473662734db`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:27.834426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:27.852782 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c143a2dbe5aa42f38319398a23c7085b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.853460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c143a2dbe5aa42f38319398a23c7085b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.861115 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c143a2dbe5aa42f38319398a23c7085b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.873600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c143a2dbe5aa42f38319398a23c7085b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:27.895868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1369/2745] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:45:27.998544 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c143a2dbe5aa42f38319398a23c7085b'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:28.006591 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1377/2746] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:27 2022] DELETE /identity/v3/users/c143a2dbe5aa42f38319398a23c7085b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:28.335443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:28.336909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:28.401703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823da4f-9a32-4fb9-b503-78e0b41b9da5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:28.454615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b5bee-5c1d-45ce-b1af-36a13f2ad789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:28.455263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b5bee-5c1d-45ce-b1af-36a13f2ad789 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:28.455565 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b5bee-5c1d-45ce-b1af-36a13f2ad789 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:28.455889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b5bee-5c1d-45ce-b1af-36a13f2ad789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:28.457897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-588b5bee-5c1d-45ce-b1af-36a13f2ad789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:28.469522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b5bee-5c1d-45ce-b1af-36a13f2ad789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:28.471129 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b5bee-5c1d-45ce-b1af-36a13f2ad789 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:28.480849 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1370/2747] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:28.601316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:28.602946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:28.677769 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ab2f4-4016-49cf-82fa-3c80165dc176 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:28.682784 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:28.683629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:28.683986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:28.685289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] PATH_INFO: `/v3/projects/ec8633dfd4f64b78a1268f288cfd3704` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:28.685624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8633dfd4f64b78a1268f288cfd3704)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:28.687644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:28.875001 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8633dfd4f64b78a1268f288cfd3704', 'request_id': 'req-c7f2e46e-2e46-4529-a591-b6751fa1d71e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:29.004470 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8633dfd4f64b78a1268f288cfd3704', 'request_id': 'req-c7f2e46e-2e46-4529-a591-b6751fa1d71e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:29.007479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:29.012731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8633dfd4f64b78a1268f288cfd3704', 'request_id': 'req-c7f2e46e-2e46-4529-a591-b6751fa1d71e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:29.025190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] The token cache is being invalidate because project ec8633dfd4f64b78a1268f288cfd3704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:29.025576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:29.026315 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-c7f2e46e-2e46-4529-a591-b6751fa1d71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:29.028119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1378/2748] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:28 2022] DELETE /identity/v3/projects/ec8633dfd4f64b78a1268f288cfd3704 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:29.032878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb798d-f520-429e-b6ea-1f922c431b74 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.033238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb798d-f520-429e-b6ea-1f922c431b74 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.033584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb798d-f520-429e-b6ea-1f922c431b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.055351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e5cb798d-f520-429e-b6ea-1f922c431b74 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:29.057259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e5cb798d-f520-429e-b6ea-1f922c431b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:29.097026 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:29.131034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1371/2749] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:45:29.139439 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa736c6-5f25-4277-84fc-32a64c158c83 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.141757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa736c6-5f25-4277-84fc-32a64c158c83 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.141757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa736c6-5f25-4277-84fc-32a64c158c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.162318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2aa736c6-5f25-4277-84fc-32a64c158c83 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:29.163541 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2aa736c6-5f25-4277-84fc-32a64c158c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:29.171694 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1379/2750] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:29.176185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb798d-f520-429e-b6ea-1f922c431b74 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:29.186763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb798d-f520-429e-b6ea-1f922c431b74 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:29.191552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:29.192211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.192491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.192815 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.193617 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:45:29.193925 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:29.195556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:29.211986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1372/2751] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:45:29.213959 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa736c6-5f25-4277-84fc-32a64c158c83 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:29.226467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa736c6-5f25-4277-84fc-32a64c158c83 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:29.231536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:29.236686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.236686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.236686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.236686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:29.236686 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:29.360440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1380/2752] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:29 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:29.364240 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:29.374458 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78713be7-1fc1-4fef-aa01-65ea6a29883f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:29.435189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:29.435864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.436144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.436539 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.437237 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:29.439166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:29.581403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1373/2753] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:29 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:29.586241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:29.596696 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e9f3-c9cd-434b-b823-bf77b9bb1d19 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:29.601489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:29.602108 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.602435 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.602821 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.603554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:29.605099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:29.615616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1381/2754] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:29.619592 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:29.631142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f29a5-ab09-4507-a8ef-50130d0a1f64 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:29.636503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a339db-59a8-41ce-8ace-9c63fb68b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:29.637149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a339db-59a8-41ce-8ace-9c63fb68b598 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.637427 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a339db-59a8-41ce-8ace-9c63fb68b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.637703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a339db-59a8-41ce-8ace-9c63fb68b598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.638348 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a339db-59a8-41ce-8ace-9c63fb68b598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:29.640077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a339db-59a8-41ce-8ace-9c63fb68b598 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:29.652159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1374/2755] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:29.656508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:29.666860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8d175-18c5-4d47-beac-84d35ba49223 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:29.671574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:29.672168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.672482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.672756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] PATH_INFO: `/v3/projects/499e3830d94942d2885b61879485b7be/users/5f38fe90db464e6aa73a3016f6a47d04/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.688026 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499e3830d94942d2885b61879485b7be, user_id=5f38fe90db464e6aa73a3016f6a47d04, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:29.697082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:29.822857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1382/2756] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:29 2022] PUT /identity/v3/projects/499e3830d94942d2885b61879485b7be/users/5f38fe90db464e6aa73a3016f6a47d04/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:29.833856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:29.834144 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:29.834422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:29.864003 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] MFA Rules not processed for user `5f38fe90db464e6aa73a3016f6a47d04`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:29.865205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:29.934215 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1375/2757] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:29.941664 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:29.944085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:30.012605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471bb4-73cd-4235-b4cd-43c0f38acec1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:30.016264 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:30.016870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:30.017147 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:30.017414 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:30.035446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:30.035446 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:30.038543 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1383/2758] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:33.577168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:33.578672 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:33.636897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:33.682100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b92f5-2113-4ad6-adef-103f83f1ae96 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:33.687892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6acc7-4ab1-44f4-831e-0d2630273aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:33.689250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6acc7-4ab1-44f4-831e-0d2630273aec service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:33.689680 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6acc7-4ab1-44f4-831e-0d2630273aec service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:33.689965 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6acc7-4ab1-44f4-831e-0d2630273aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:33.692556 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b1b6acc7-4ab1-44f4-831e-0d2630273aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:33.705840 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6acc7-4ab1-44f4-831e-0d2630273aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:33.708157 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6acc7-4ab1-44f4-831e-0d2630273aec service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:33.719900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1376/2759] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:35.721524 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:35.789282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0b58-02bb-4d23-b3ea-ce8d0aee07f2 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:35.794251 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:35.794878 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:35.795168 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:35.795478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] PATH_INFO: `/v3/users/5f38fe90db464e6aa73a3016f6a47d04` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:35.796655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f38fe90db464e6aa73a3016f6a47d04)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:35.798567 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:35.964883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:36.109761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f38fe90db464e6aa73a3016f6a47d04'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:36.110534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f38fe90db464e6aa73a3016f6a47d04'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:36.118021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f38fe90db464e6aa73a3016f6a47d04'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:36.130850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f38fe90db464e6aa73a3016f6a47d04'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:36.197720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f38fe90db464e6aa73a3016f6a47d04'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:36.204548 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1384/2760] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:45:35 2022] DELETE /identity/v3/users/5f38fe90db464e6aa73a3016f6a47d04 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:36.209863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:36.210366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:36.210366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:36.229834 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:36.231106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:36.290973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1377/2761] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:36.300950 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:36.302579 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:36.361263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d4c14-099e-4f20-a42b-2cc452516cd4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:36.365243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7517ec2-9872-450f-8b1f-d48a853b0d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:36.365868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7517ec2-9872-450f-8b1f-d48a853b0d6d service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:36.366180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7517ec2-9872-450f-8b1f-d48a853b0d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:36.366482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7517ec2-9872-450f-8b1f-d48a853b0d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:36.376525 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7517ec2-9872-450f-8b1f-d48a853b0d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:36.378019 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7517ec2-9872-450f-8b1f-d48a853b0d6d service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:36.389556 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1385/2762] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:37.096328 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:37.097862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:37.110567 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728096fc-c952-4fc8-ad27-2e1b677fcf92 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:37.115949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:37.116679 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.116957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.117251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] PATH_INFO: `/v3/projects/499e3830d94942d2885b61879485b7be` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.118502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499e3830d94942d2885b61879485b7be)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:37.120483 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:37.244761 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499e3830d94942d2885b61879485b7be', 'request_id': 'req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:37.335319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499e3830d94942d2885b61879485b7be', 'request_id': 'req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:37.341615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499e3830d94942d2885b61879485b7be', 'request_id': 'req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:37.353443 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] The token cache is being invalidate because project 499e3830d94942d2885b61879485b7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:45:37.353734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:37.354422 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c36fcd91-d9a3-4b1a-8d34-e795a6367b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:45:37.355928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1378/2763] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:45:37 2022] DELETE /identity/v3/projects/499e3830d94942d2885b61879485b7be => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:45:37.360914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ae73-24e0-4b88-aee0-5075df1c30ee None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.361410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ae73-24e0-4b88-aee0-5075df1c30ee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.361410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9ae73-24e0-4b88-aee0-5075df1c30ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.381119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-39e9ae73-24e0-4b88-aee0-5075df1c30ee None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:37.382299 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-39e9ae73-24e0-4b88-aee0-5075df1c30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:37.441407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1386/2764] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:37.506078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd9cf-64ab-4d31-b922-7f3d725b2eff None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.506364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd9cf-64ab-4d31-b922-7f3d725b2eff None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.506647 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd9cf-64ab-4d31-b922-7f3d725b2eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.527508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-493fd9cf-64ab-4d31-b922-7f3d725b2eff None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:37.528724 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-493fd9cf-64ab-4d31-b922-7f3d725b2eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:37.537584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1379/2765] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:37.541904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ae73-24e0-4b88-aee0-5075df1c30ee None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:37.552008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9ae73-24e0-4b88-aee0-5075df1c30ee None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:37.556768 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:37.557362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.557642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.557916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.558566 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:45:37.558870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:37.560508 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:37.572170 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1387/2766] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:45:37.576521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd9cf-64ab-4d31-b922-7f3d725b2eff None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:37.586449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd9cf-64ab-4d31-b922-7f3d725b2eff None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:37.591180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:37.591796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.592077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.592352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.592986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:37.594876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:37.683524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1380/2767] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:45:37 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:37.685723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:37.696199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985436-5914-42f3-8789-df146341cc9b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:37.727358 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:37.753719 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:37.754370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.754647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.754924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.756135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:37.757581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:37.915662 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1388/2768] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:45:37 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:45:37.917263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:37.929033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952e04d-4edb-4e2d-a19c-61ac29be4f8d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:37.933933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:37.934541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.934887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.935166 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.935957 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:37.937600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:37.940203 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:37.949017 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1381/2769] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:37.953156 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:37.964116 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cfd8b-a7b1-4f1e-87c1-c5d3a31a9442 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:37.968904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459c1f1-32c5-4f77-9d70-bc8d94f28239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:37.969818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459c1f1-32c5-4f77-9d70-bc8d94f28239 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:37.969818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459c1f1-32c5-4f77-9d70-bc8d94f28239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:37.970034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459c1f1-32c5-4f77-9d70-bc8d94f28239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:37.970670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459c1f1-32c5-4f77-9d70-bc8d94f28239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:37.972277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459c1f1-32c5-4f77-9d70-bc8d94f28239 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:37.984985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1389/2770] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:45:37.989187 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:37.999450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe02b-402f-4d7d-b861-edd7acc3e3ce admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:38.004084 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:38.005262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:38.005529 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:38.005798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] PATH_INFO: `/v3/projects/3de0cc0ddb844add843e378f4a531584/users/c7639bc8f48b4d1eb88e6f1895d75744/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:38.021425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de0cc0ddb844add843e378f4a531584, user_id=c7639bc8f48b4d1eb88e6f1895d75744, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:38.024085 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:38.095949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1382/2771] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:45:37 2022] PUT /identity/v3/projects/3de0cc0ddb844add843e378f4a531584/users/c7639bc8f48b4d1eb88e6f1895d75744/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:45:38.106242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c822ac-1098-472a-821f-46bb52a95c58 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:38.106242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c822ac-1098-472a-821f-46bb52a95c58 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:38.106242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c822ac-1098-472a-821f-46bb52a95c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:38.121121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-30c822ac-1098-472a-821f-46bb52a95c58 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:38.122354 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-30c822ac-1098-472a-821f-46bb52a95c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:38.182674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1390/2772] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:38.193351 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:38.195210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:38.256267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b21e4c-80f0-45bb-a74b-b7f8fc36b94b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:38.260283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:38.260892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:38.261173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:38.261447 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:38.272400 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:38.273895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:38.284201 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1383/2773] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:39.935561 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:39.936146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:39.936146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:39.965546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] MFA Rules not processed for user `c7639bc8f48b4d1eb88e6f1895d75744`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:39.966812 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:40.035452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1391/2774] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:45:40.050642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:40.050642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:40.117579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca745d-cd93-4ae0-9302-dbb2152ab9b7 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:40.121269 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40724f-7491-450e-8480-3ddb1b2f972f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:40.121883 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40724f-7491-450e-8480-3ddb1b2f972f service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:40.122164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40724f-7491-450e-8480-3ddb1b2f972f service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:40.122480 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40724f-7491-450e-8480-3ddb1b2f972f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:40.132089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40724f-7491-450e-8480-3ddb1b2f972f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:40.133534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40724f-7491-450e-8480-3ddb1b2f972f service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:40.143584 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1384/2775] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:40.165065 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:40.166787 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:40.215082 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:40.252974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e819c-8968-47d7-99a0-7b98d5e0e4e6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:40.261233 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:40.261868 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:40.262141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:40.262412 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:40.264416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:40.278737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:40.280443 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:40.294428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1392/2776] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:45:42.017773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:42.018327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:42.018327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:42.043205 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] MFA Rules not processed for user `c7639bc8f48b4d1eb88e6f1895d75744`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:45:42.044479 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:42.052513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1385/2777] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:45:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:45:42.856582 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:42.858896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:42.945059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe42159-5663-4011-89ad-8f72480d9972 service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:42.950141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5299-2066-4dcc-9650-1f66a4c951ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:42.950742 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5299-2066-4dcc-9650-1f66a4c951ff service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:42.951018 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5299-2066-4dcc-9650-1f66a4c951ff service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:42.951284 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5299-2066-4dcc-9650-1f66a4c951ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:42.953067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e31a5299-2066-4dcc-9650-1f66a4c951ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:42.965665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a5299-2066-4dcc-9650-1f66a4c951ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:42.967304 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a5299-2066-4dcc-9650-1f66a4c951ff service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:42.977979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1393/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:47.133491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:45:47.135298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:47.153560 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb54948-0251-406c-bdc8-5e216421bbed None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:45:47.159548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:45:47.160699 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:45:47.160978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:45:47.161250 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:45:47.163138 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:45:47.178104 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:45:47.179749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:45:47.191072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1386/2779] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:45:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:45:52.973493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=47 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:45:57.186211 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:46:20.132247 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7a37-fa25-4627-b0bc-458ecc267b5b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:20.132837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7a37-fa25-4627-b0bc-458ecc267b5b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:20.132837 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f7a37-fa25-4627-b0bc-458ecc267b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:20.152982 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-316f7a37-fa25-4627-b0bc-458ecc267b5b None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:46:20.154212 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-316f7a37-fa25-4627-b0bc-458ecc267b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:20.162149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1394/2780] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:46:20.188281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:46:20.201990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604ab04-3d18-4e78-af85-f00fb205d1f4 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:46:20.209832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:46:20.210441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:20.210720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:20.210994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:20.220015 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:46:20.221629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:46:20.231185 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1387/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:46:25.321318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2665ca-b92a-485b-82b5-39101f443fc8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:25.321967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2665ca-b92a-485b-82b5-39101f443fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:25.321967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2665ca-b92a-485b-82b5-39101f443fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:25.342423 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fd2665ca-b92a-485b-82b5-39101f443fc8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:46:25.343678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fd2665ca-b92a-485b-82b5-39101f443fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:25.351828 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1395/2782] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:46:25.372502 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:46:25.384673 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedab7aa-1a15-4066-b0ed-943c832d82ad service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:46:25.390496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:46:25.391091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:25.391398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:25.391670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:25.400390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:46:25.401970 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:46:25.411723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1388/2783] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:46:29.790873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e851-d370-46b2-9def-f98128fde238 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:29.791459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e851-d370-46b2-9def-f98128fde238 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:29.791459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6e851-d370-46b2-9def-f98128fde238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:29.811210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7ec6e851-d370-46b2-9def-f98128fde238 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:46:29.812430 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7ec6e851-d370-46b2-9def-f98128fde238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:29.820319 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1396/2784] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:46:29.843862 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:46:29.857886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa583c3-c657-461d-b0da-68b03d25dbef service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:46:29.867096 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:46:29.867757 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:29.868040 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:29.868316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:29.877361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:46:29.878939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:46:29.890906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1389/2785] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:46:33.693418 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409763d5-4107-45d6-a22c-34a660b11bf6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:33.693974 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409763d5-4107-45d6-a22c-34a660b11bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:33.694176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409763d5-4107-45d6-a22c-34a660b11bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:33.714072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-409763d5-4107-45d6-a22c-34a660b11bf6 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:46:33.715290 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-409763d5-4107-45d6-a22c-34a660b11bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:33.723838 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1397/2786] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:46:33.746866 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:46:33.759142 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c25204-d3c6-4975-871a-e66a240faa8d service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:46:33.765210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:46:33.765875 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:33.766152 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:33.766424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:33.775428 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:46:33.777012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:46:33.786881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1390/2787] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:46:37.939681 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4460d-4501-4150-be6f-b2b077033ee1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:37.940224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4460d-4501-4150-be6f-b2b077033ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:37.940224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4460d-4501-4150-be6f-b2b077033ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:37.960061 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fdc4460d-4501-4150-be6f-b2b077033ee1 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:46:37.961275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fdc4460d-4501-4150-be6f-b2b077033ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:37.969189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1398/2788] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:46:37.998180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:46:38.009808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46e95-b231-4edd-a45b-8800c4a59b3c service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:46:38.015841 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:46:38.016438 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:38.016720 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:38.016991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:38.025285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:46:38.026857 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:46:38.036904 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1391/2789] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:46:42.214854 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275e820-07b4-4d19-8785-f963fbc97997 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:42.215458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275e820-07b4-4d19-8785-f963fbc97997 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:42.215458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275e820-07b4-4d19-8785-f963fbc97997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:42.235517 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1275e820-07b4-4d19-8785-f963fbc97997 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:46:42.236709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1275e820-07b4-4d19-8785-f963fbc97997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:42.245465 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1399/2790] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:46:42.267879 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:46:42.279550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b7b6c-ce38-4b6d-9b9c-d2314f45dc7c service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:46:42.285991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:46:42.286629 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:42.286912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:42.287189 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:42.296364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:46:42.297937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:46:42.308061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1392/2791] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:46:52.230222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=18 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:46:52.303199 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=36 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:46:59.604756 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577334b5-b22e-4b19-bc07-a03c488f5886 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:59.605348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577334b5-b22e-4b19-bc07-a03c488f5886 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:59.605348 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577334b5-b22e-4b19-bc07-a03c488f5886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:59.626547 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-577334b5-b22e-4b19-bc07-a03c488f5886 None None] MFA Rules not processed for user `c7639bc8f48b4d1eb88e6f1895d75744`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:46:59.627817 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-577334b5-b22e-4b19-bc07-a03c488f5886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:59.635084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1400/2792] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:46:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:46:59.916890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:46:59.930154 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4d54-536d-4a73-9f67-a76665db0ad6 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:46:59.934956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:46:59.936597 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:46:59.937055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:46:59.937506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:46:59.940183 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:46:59.951803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:46:59.953747 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:46:59.964722 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1393/2793] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:46:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:47:09.619427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:47:09.960609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:47:19.849054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20007a-f767-4ab2-90cd-0db0da93eccc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:19.849658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20007a-f767-4ab2-90cd-0db0da93eccc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:19.849658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20007a-f767-4ab2-90cd-0db0da93eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:19.873210 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ea20007a-f767-4ab2-90cd-0db0da93eccc None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:47:19.874485 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ea20007a-f767-4ab2-90cd-0db0da93eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:19.883089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1401/2794] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:47:19.904893 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:47:19.925685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455cd2-61d8-43d9-a710-dfd4eb4aaf39 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:47:19.935491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:47:19.936554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:19.937357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:19.937863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:19.952424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:47:19.954393 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:47:19.966854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1394/2795] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:47:24.468964 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd12d-de52-4cc0-a812-8111d7605c99 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:24.469534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd12d-de52-4cc0-a812-8111d7605c99 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:24.469534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fd12d-de52-4cc0-a812-8111d7605c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:24.491916 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c12fd12d-de52-4cc0-a812-8111d7605c99 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:47:24.493140 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c12fd12d-de52-4cc0-a812-8111d7605c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:24.501137 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1402/2796] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:47:24.522027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:47:24.534258 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad157-5442-48b7-947a-8f394410ced0 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:47:24.540148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:47:24.540751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:24.541034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:24.541313 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:24.550914 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:47:24.552548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:47:24.563296 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1395/2797] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:47:28.415779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452885e-eec2-494e-b0ed-ce67a4f35912 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:28.416818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452885e-eec2-494e-b0ed-ce67a4f35912 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:28.416818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452885e-eec2-494e-b0ed-ce67a4f35912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:28.438059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4452885e-eec2-494e-b0ed-ce67a4f35912 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:47:28.439451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4452885e-eec2-494e-b0ed-ce67a4f35912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:28.448325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1403/2798] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:47:28.469429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:47:28.482583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd114f-3b5e-4e54-aa97-9e7d656259ed service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:47:28.489513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:47:28.490218 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:28.490501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:28.490773 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:28.499830 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:47:28.502173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:47:28.531227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1396/2799] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:47:32.722893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a835f4-c2ac-43ad-9753-0296cd3cb4ce None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:32.723565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a835f4-c2ac-43ad-9753-0296cd3cb4ce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:32.723680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a835f4-c2ac-43ad-9753-0296cd3cb4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:32.744297 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c6a835f4-c2ac-43ad-9753-0296cd3cb4ce None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:47:32.745529 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c6a835f4-c2ac-43ad-9753-0296cd3cb4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:32.754286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1404/2800] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:47:32.774248 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:47:32.785810 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447676-968f-4de8-ae6c-7775e92bff1e service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:47:32.791371 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:47:32.791974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:32.792833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:32.792833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:32.802196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:47:32.803811 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:47:32.814324 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1397/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:47:36.047737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b37a7-93ba-432f-af5f-4231d2bc2bcf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:36.048311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b37a7-93ba-432f-af5f-4231d2bc2bcf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:36.048733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b37a7-93ba-432f-af5f-4231d2bc2bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:36.083860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3a2b37a7-93ba-432f-af5f-4231d2bc2bcf None None] MFA Rules not processed for user `e790386cb0b64961871a6473662734db`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:47:36.086039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3a2b37a7-93ba-432f-af5f-4231d2bc2bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:36.148839 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1405/2802] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:47:36.485100 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:47:36.486684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:36.499903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae56e-22a5-44d5-92ee-76f9327fad88 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:47:36.504383 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:47:36.504990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:36.505270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:36.505544 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:36.507453 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:36.517917 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:47:36.520728 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:47:36.529401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1398/2803] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:47:37.007440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:37.007736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:37.008011 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:37.035488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:47:37.037590 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:47:37.045738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1406/2804] 10.222.0.62 () {58 vars in 1016 bytes} [Mon Sep 26 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:47:37.067988 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:47:37.085360 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8616b-3283-462d-ad10-f944f2e38401 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:47:37.091896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:47:37.092521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:47:37.092802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:47:37.093077 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:47:37.102213 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:47:37.103824 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:47:37.113962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1399/2805] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:47:47.028240 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=40 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:47:47.109734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=36 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:48:16.596045 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:48:16.597499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:48:16.612416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561e23e-3c28-48b7-a965-a15777fccdcc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:48:16.617887 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:48:16.618488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:48:16.618851 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:48:16.619120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:48:16.620850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:48:16.633757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:48:16.635658 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:48:16.646280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1407/2806] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:48:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:48:16.744108 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:48:16.754255 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e3c2-21f9-47e3-8f1e-ef9411b8f728 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:48:16.759525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:48:16.760440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:48:16.760718 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:48:16.760990 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] PATH_INFO: `/v3/users/c7639bc8f48b4d1eb88e6f1895d75744` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:48:16.762140 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7639bc8f48b4d1eb88e6f1895d75744)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:48:16.764226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:48:16.978449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7639bc8f48b4d1eb88e6f1895d75744'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.062091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7639bc8f48b4d1eb88e6f1895d75744'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.077135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7639bc8f48b4d1eb88e6f1895d75744'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.077135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7639bc8f48b4d1eb88e6f1895d75744'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.084819 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7639bc8f48b4d1eb88e6f1895d75744'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.091928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1400/2807] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:48:16 2022] DELETE /identity/v3/users/c7639bc8f48b4d1eb88e6f1895d75744 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:48:17.343621 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:48:17.355161 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c530c-9173-4bd6-b203-b45c7da5c240 service placement] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:48:17.421216 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:48:17.422117 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:48:17.422523 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:48:17.422929 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] PATH_INFO: `/v3/projects/3de0cc0ddb844add843e378f4a531584` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:48:17.424573 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de0cc0ddb844add843e378f4a531584)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:48:17.427745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:48:17.549467 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de0cc0ddb844add843e378f4a531584', 'request_id': 'req-64f1bd62-22aa-4e51-aefc-30560ebbefaf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.611385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de0cc0ddb844add843e378f4a531584', 'request_id': 'req-64f1bd62-22aa-4e51-aefc-30560ebbefaf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.618605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de0cc0ddb844add843e378f4a531584', 'request_id': 'req-64f1bd62-22aa-4e51-aefc-30560ebbefaf'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.630120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] The token cache is being invalidate because project 3de0cc0ddb844add843e378f4a531584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:48:17.630408 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.631066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:48:17.632804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1408/2808] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:48:17 2022] DELETE /identity/v3/projects/3de0cc0ddb844add843e378f4a531584 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:48:27.088524 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:48:27.626958 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:48:36.642002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:48:36.643555 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:48:36.714835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430b1df-46b3-46d1-aa48-6799a26cff2f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:48:36.786752 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2da44f-7be6-44af-b563-2a59ba012d5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:48:36.787401 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2da44f-7be6-44af-b563-2a59ba012d5f service placement] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:48:36.787677 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2da44f-7be6-44af-b563-2a59ba012d5f service placement] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:48:36.787953 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2da44f-7be6-44af-b563-2a59ba012d5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:48:36.789804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4b2da44f-7be6-44af-b563-2a59ba012d5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:48:36.802032 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2da44f-7be6-44af-b563-2a59ba012d5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:48:36.803700 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2da44f-7be6-44af-b563-2a59ba012d5f service placement] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:48:36.814262 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1401/2809] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:48:46.809769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=58 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:49:06.673656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:49:06.676050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:49:06.768090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bd62-22aa-4e51-aefc-30560ebbefaf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:49:06.774066 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:49:06.774690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:49:06.774972 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:49:06.775244 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:49:06.777067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:49:06.849282 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:49:06.851488 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:49:06.863962 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1409/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:49:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:49:16.858577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=56 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:49:23.483228 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:49:23.486995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:49:23.486995 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:49:23.503814 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] MFA Rules not processed for user `e790386cb0b64961871a6473662734db`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:49:23.505072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:49:23.512848 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1402/2811] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:49:33.497850 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:50:30.304376 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:50:30.305932 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:30.363150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cf314-2925-494c-b4cc-b06c85d46bdc service nova] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:50:30.366943 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:50:30.367600 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:50:30.367888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:50:30.368163 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:50:30.369911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:30.379618 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:50:30.381038 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:50:30.389332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1410/2812] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:50:40.385677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=26 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:50:45.005557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:50:45.007083 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:45.068220 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509c92a-62b1-4a39-9741-de5c0a4b49b9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:50:45.073192 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:50:45.073821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:50:45.074103 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:50:45.074375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:50:45.076161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:45.090853 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:50:45.092419 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:50:45.104338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1403/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:50:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:50:48.436303 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:50:48.437747 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:48.452777 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3435a4f-ad55-4fe9-9353-2e8c8fcc2474 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:50:48.456367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:50:48.456966 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:50:48.457243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:50:48.457515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:50:48.459194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:48.494030 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:50:48.495501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:50:48.506518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1411/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:50:54.406219 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:50:54.407784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:54.453543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62855a-8c39-4c96-a50c-f35fc6d1fca2 service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:50:54.459827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952c5c9a37a54497aab20652d0282690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:50:54.460531 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:50:54.461354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:50:54.461643 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:50:54.463658 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:50:54.482713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:50:54.484662 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:50:54.497525 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1404/2815] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:50:58.501565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=17 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:01.533181 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:01.545180 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59b4c9-dbaf-40b2-9003-68b49a2872d0 service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:01.549546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:01.550204 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:01.550479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:01.550759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:01.553266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:01.629796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:01.631256 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:01.642489 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1412/2816] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:04.492263 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=43 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:05.270583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:05.272242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:05.288714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511357a-6495-43f4-bf61-7fe1a5bb8df6 service nova] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:05.294105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:05.294695 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:05.295057 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:05.295452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] PATH_INFO: `/v3/users/e790386cb0b64961871a6473662734db` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:05.296651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e790386cb0b64961871a6473662734db)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:05.298607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:05.481055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e790386cb0b64961871a6473662734db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:05.603791 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e790386cb0b64961871a6473662734db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:05.617413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e790386cb0b64961871a6473662734db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:05.618092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e790386cb0b64961871a6473662734db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:05.626082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-bc8ac195-e215-46c3-b40d-160942847e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e790386cb0b64961871a6473662734db'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:05.632229 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1405/2817] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:05 2022] DELETE /identity/v3/users/e790386cb0b64961871a6473662734db => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:05.891939 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:05.903008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc959b01-f34d-4d71-ab0a-71323cca2a2d service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:05.964215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:05.965448 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:05.965726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:05.966037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] PATH_INFO: `/v3/projects/757d84dd09aa401782bc3cfeeffc1ede` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:05.967190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=757d84dd09aa401782bc3cfeeffc1ede)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:05.969133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:06.106557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '757d84dd09aa401782bc3cfeeffc1ede', 'request_id': 'req-d93b46f0-228c-4d47-b871-a0db1a0a3744'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:06.189913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '757d84dd09aa401782bc3cfeeffc1ede', 'request_id': 'req-d93b46f0-228c-4d47-b871-a0db1a0a3744'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:06.196329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '757d84dd09aa401782bc3cfeeffc1ede', 'request_id': 'req-d93b46f0-228c-4d47-b871-a0db1a0a3744'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:06.207910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] The token cache is being invalidate because project 757d84dd09aa401782bc3cfeeffc1ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:06.208224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:06.208882 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-d93b46f0-228c-4d47-b871-a0db1a0a3744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:06.210367 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1413/2818] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:05 2022] DELETE /identity/v3/projects/757d84dd09aa401782bc3cfeeffc1ede => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:06.215864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec45c-cad3-4c71-a926-6fceda990d2a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.216148 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec45c-cad3-4c71-a926-6fceda990d2a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.216425 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecec45c-cad3-4c71-a926-6fceda990d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.236889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6ecec45c-cad3-4c71-a926-6fceda990d2a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:06.238080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6ecec45c-cad3-4c71-a926-6fceda990d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:06.298803 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1406/2819] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 12:51:06.307479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3056c3-70d2-4707-bd7c-db3c011e500a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.307871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3056c3-70d2-4707-bd7c-db3c011e500a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.308151 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3056c3-70d2-4707-bd7c-db3c011e500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.331487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fe3056c3-70d2-4707-bd7c-db3c011e500a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:06.331487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fe3056c3-70d2-4707-bd7c-db3c011e500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:06.340477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1414/2820] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:06.344601 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec45c-cad3-4c71-a926-6fceda990d2a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:06.354770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecec45c-cad3-4c71-a926-6fceda990d2a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:06.359697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:06.360301 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.360581 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.360854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.361501 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:51:06.361802 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:06.363414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:06.375632 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1407/2821] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:51:06.380023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3056c3-70d2-4707-bd7c-db3c011e500a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:06.390190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3056c3-70d2-4707-bd7c-db3c011e500a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:06.395072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:06.395713 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.395996 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.396269 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.396906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:06.398832 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:06.415133 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:06.505368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1415/2822] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:06 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:06.509981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:06.520997 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7924e3-fd81-4745-98ba-0be41473903a admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:06.586270 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:06.586809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.587075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.587365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.588010 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:06.589922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:06.598508 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:06.710122 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1408/2823] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:06 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:51:06.714380 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:06.724779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639153c-4bce-43a1-8978-d5be8cd783a1 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:06.729340 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:06.729938 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.730218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.730487 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.731178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:06.733090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:06.743904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1416/2824] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:06.748929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:06.759072 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c92ca-06a4-4b98-bd9e-7db26cbd3f8c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:06.764896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60834-b532-4040-8039-3692951c9e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:06.765521 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60834-b532-4040-8039-3692951c9e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.765804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60834-b532-4040-8039-3692951c9e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.766082 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60834-b532-4040-8039-3692951c9e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.766737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e60834-b532-4040-8039-3692951c9e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:06.768466 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e60834-b532-4040-8039-3692951c9e77 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:06.779763 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1409/2825] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:06.784166 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:06.794149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22555315-4f03-4164-9205-a53b72e3ba77 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:06.798728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:06.799437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.799715 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.799986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] PATH_INFO: `/v3/projects/130f08c50dde49428b46fc29c90d12f5/users/2047ab06437e49e9b3336dc8f1f2ae1b/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.815703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130f08c50dde49428b46fc29c90d12f5, user_id=2047ab06437e49e9b3336dc8f1f2ae1b, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:06.818396 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:06.881677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1417/2826] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:06 2022] PUT /identity/v3/projects/130f08c50dde49428b46fc29c90d12f5/users/2047ab06437e49e9b3336dc8f1f2ae1b/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:06.893277 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94b28-a506-4030-a7c0-f6feda760ed3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:06.893678 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94b28-a506-4030-a7c0-f6feda760ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:06.893961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94b28-a506-4030-a7c0-f6feda760ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:06.935239 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4bf94b28-a506-4030-a7c0-f6feda760ed3 None None] MFA Rules not processed for user `2047ab06437e49e9b3336dc8f1f2ae1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:06.936600 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4bf94b28-a506-4030-a7c0-f6feda760ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:07.007669 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1410/2827] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:07.012526 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:07.077442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b0a5b-e162-4a7a-b5cb-469fe0b8fcc6 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:07.082501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:07.083141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.092373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.092373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.092373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:07.092373 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:07.208899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1418/2828] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:07 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:07.213027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94b28-a506-4030-a7c0-f6feda760ed3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:07.223908 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94b28-a506-4030-a7c0-f6feda760ed3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:07.284031 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:07.284650 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.284926 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.285195 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.285829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:07.287852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:07.364842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1411/2829] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:07 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:07.368836 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:07.379169 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf279-ed82-4f3a-b28a-dd92bd5fd41c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:07.383808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:07.384407 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.384944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.385231 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.385850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:07.387450 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:07.398241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1419/2830] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:07.402554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:07.413440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184e370-034a-4edb-9a9a-79270f9b3cb3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:07.418126 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:07.418775 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.419054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.419334 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] PATH_INFO: `/v3/projects/07117d85649448248898ce5f1a38a7fc/users/c2a2f9f07b814aca8b62dc4557e40135/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.436493 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07117d85649448248898ce5f1a38a7fc, user_id=c2a2f9f07b814aca8b62dc4557e40135, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:07.439069 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:07.512318 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1412/2831] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:07 2022] PUT /identity/v3/projects/07117d85649448248898ce5f1a38a7fc/users/c2a2f9f07b814aca8b62dc4557e40135/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:07.516538 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:07.526504 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa584ad3-81bc-4469-91a2-1a717dad4ac8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:07.588655 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd853d7-64bf-4c4f-b0ac-b18953ae605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:07.589275 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd853d7-64bf-4c4f-b0ac-b18953ae605f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.589554 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd853d7-64bf-4c4f-b0ac-b18953ae605f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.589827 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd853d7-64bf-4c4f-b0ac-b18953ae605f admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.590480 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd853d7-64bf-4c4f-b0ac-b18953ae605f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:07.593073 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd853d7-64bf-4c4f-b0ac-b18953ae605f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:07.603466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1420/2832] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:51:07.608933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:07.619959 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114001f-ba11-4761-9860-f97125e2e030 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:07.624714 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:07.625372 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.625656 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.625937 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] PATH_INFO: `/v3/projects/07117d85649448248898ce5f1a38a7fc/users/c2a2f9f07b814aca8b62dc4557e40135/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.627890 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07117d85649448248898ce5f1a38a7fc, user_id=c2a2f9f07b814aca8b62dc4557e40135, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:07.630506 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:07.641533 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1413/2833] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:07 2022] PUT /identity/v3/projects/07117d85649448248898ce5f1a38a7fc/users/c2a2f9f07b814aca8b62dc4557e40135/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:07.653232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf83f-82a7-431f-8f49-c3cc92bd1554 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.653514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf83f-82a7-431f-8f49-c3cc92bd1554 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.654332 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf83f-82a7-431f-8f49-c3cc92bd1554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.682976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a6eaf83f-82a7-431f-8f49-c3cc92bd1554 None None] MFA Rules not processed for user `c2a2f9f07b814aca8b62dc4557e40135`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:07.684296 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a6eaf83f-82a7-431f-8f49-c3cc92bd1554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:07.705143 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:07.755459 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1421/2834] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:07.768161 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:07.773976 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:07.794291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:07.831291 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e473f8-7776-4a54-923a-d2d5cd955f9b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:07.835133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:07.835766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:07.836045 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:07.836316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:07.846579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:07.848151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:07.858012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1414/2835] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:08.099842 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaf83f-82a7-431f-8f49-c3cc92bd1554 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:08.110009 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaf83f-82a7-431f-8f49-c3cc92bd1554 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:08.113797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099dba3-a182-494d-9a64-f8d4e1fa39f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:08.114392 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099dba3-a182-494d-9a64-f8d4e1fa39f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:08.114678 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099dba3-a182-494d-9a64-f8d4e1fa39f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:08.114952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099dba3-a182-494d-9a64-f8d4e1fa39f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:08.174221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099dba3-a182-494d-9a64-f8d4e1fa39f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:08.175589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099dba3-a182-494d-9a64-f8d4e1fa39f0 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:08.184819 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1422/2836] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:11.982670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:12.050417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c9fcc-5144-4082-b2df-f1e9a63ab6de service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:12.055092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:12.055749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:12.056028 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:12.056298 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] PATH_INFO: `/v3/users/2047ab06437e49e9b3336dc8f1f2ae1b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:12.057492 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2047ab06437e49e9b3336dc8f1f2ae1b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:12.059429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:12.335837 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2047ab06437e49e9b3336dc8f1f2ae1b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:12.409000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2047ab06437e49e9b3336dc8f1f2ae1b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:12.421923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2047ab06437e49e9b3336dc8f1f2ae1b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:12.422585 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2047ab06437e49e9b3336dc8f1f2ae1b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:12.430921 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2047ab06437e49e9b3336dc8f1f2ae1b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:12.436950 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1415/2837] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:11 2022] DELETE /identity/v3/users/2047ab06437e49e9b3336dc8f1f2ae1b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:12.442823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:12.442823 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:12.443532 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:12.462951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:12.464199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:12.528314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1423/2838] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:12.538557 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:12.540054 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:12.588375 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:12.601198 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dcd03-8aa7-4ec7-a710-1c2ecafbbda6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:12.605078 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:12.605684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:12.605958 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:12.606226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:12.616257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:12.617729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:12.627478 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1416/2839] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:13.056584 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:13.061262 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:13.072472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed321e0-dcfb-4fb6-b2e5-d60e82eedad7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:13.079189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:13.081427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:13.082022 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:13.082530 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] PATH_INFO: `/v3/projects/130f08c50dde49428b46fc29c90d12f5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:13.084850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] RBAC: Authorizing `identity:delete_project(project_id=130f08c50dde49428b46fc29c90d12f5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:13.088757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:13.214220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130f08c50dde49428b46fc29c90d12f5', 'request_id': 'req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.215915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:13.300005 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130f08c50dde49428b46fc29c90d12f5', 'request_id': 'req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.306223 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130f08c50dde49428b46fc29c90d12f5', 'request_id': 'req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.318372 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] The token cache is being invalidate because project 130f08c50dde49428b46fc29c90d12f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:13.318663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.319371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.320871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1424/2840] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:13 2022] DELETE /identity/v3/projects/130f08c50dde49428b46fc29c90d12f5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:13.325011 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:13.335842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f4135-33ec-4bad-b0ab-c20b20c82bf9 service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:13.394509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:13.395143 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:13.395515 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:13.395796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] PATH_INFO: `/v3/users/c2a2f9f07b814aca8b62dc4557e40135` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:13.396941 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a2f9f07b814aca8b62dc4557e40135)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:13.398865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:13.595217 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a2f9f07b814aca8b62dc4557e40135'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.666247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a2f9f07b814aca8b62dc4557e40135'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.680224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a2f9f07b814aca8b62dc4557e40135'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.680913 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a2f9f07b814aca8b62dc4557e40135'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.688472 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-614b4056-9e17-4658-8564-f0fc493e8ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a2f9f07b814aca8b62dc4557e40135'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:13.695462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1417/2841] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:13 2022] DELETE /identity/v3/users/c2a2f9f07b814aca8b62dc4557e40135 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:14.125059 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:14.126703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:14.141462 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79a8e0-b804-4d86-8ed9-4cd5b8ab490a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:14.204706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:14.205960 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.206220 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.206495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] PATH_INFO: `/v3/projects/07117d85649448248898ce5f1a38a7fc` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.207726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07117d85649448248898ce5f1a38a7fc)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:14.209648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:14.311830 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07117d85649448248898ce5f1a38a7fc', 'request_id': 'req-166a5275-4fe5-4c38-8449-7dc00bc74906'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:14.374368 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07117d85649448248898ce5f1a38a7fc', 'request_id': 'req-166a5275-4fe5-4c38-8449-7dc00bc74906'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:14.381470 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07117d85649448248898ce5f1a38a7fc', 'request_id': 'req-166a5275-4fe5-4c38-8449-7dc00bc74906'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:14.393289 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] The token cache is being invalidate because project 07117d85649448248898ce5f1a38a7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:14.393518 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:14.394174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-166a5275-4fe5-4c38-8449-7dc00bc74906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:14.395736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1425/2842] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:14 2022] DELETE /identity/v3/projects/07117d85649448248898ce5f1a38a7fc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:14.406238 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e48aae-0b21-445c-b8e6-62b158d27b74 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.406827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e48aae-0b21-445c-b8e6-62b158d27b74 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.406827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e48aae-0b21-445c-b8e6-62b158d27b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.427172 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-37e48aae-0b21-445c-b8e6-62b158d27b74 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:14.428413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-37e48aae-0b21-445c-b8e6-62b158d27b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:14.490503 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1418/2843] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:14.499121 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb22087-29fe-4370-a205-d40d737ddd9a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.499445 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb22087-29fe-4370-a205-d40d737ddd9a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.499723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb22087-29fe-4370-a205-d40d737ddd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.520997 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-deb22087-29fe-4370-a205-d40d737ddd9a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:14.522205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-deb22087-29fe-4370-a205-d40d737ddd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:14.530243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1426/2844] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:14.534742 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e48aae-0b21-445c-b8e6-62b158d27b74 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:14.541006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:14.544762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e48aae-0b21-445c-b8e6-62b158d27b74 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:14.549994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:14.554909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.554909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.554909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.554909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:51:14.554909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:14.554909 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:14.566276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1419/2845] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:51:14.571152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb22087-29fe-4370-a205-d40d737ddd9a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:14.581021 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb22087-29fe-4370-a205-d40d737ddd9a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:14.585831 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:14.586427 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.586703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.586986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.587642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:14.589581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:14.746113 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1427/2846] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:14 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:14.750373 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:14.761111 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162a24b-d704-4c85-ac11-d1ceca8655cd admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:14.821723 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:14.822332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.822612 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.822885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.823543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:14.825457 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:14.910311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1420/2847] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:14 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:14.914540 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:14.925182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638fc05b-5780-4e41-b19b-78c8207eaee8 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:14.930647 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:14.932987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.932987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.932987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.932987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:14.934037 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:14.944642 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1428/2848] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:14.948868 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:14.960022 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23655a11-ec5a-40ec-b63d-4f44b082b52c admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:14.965267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951391a9-0b89-4255-9357-40dbc57cc892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:14.965895 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951391a9-0b89-4255-9357-40dbc57cc892 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:14.967776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951391a9-0b89-4255-9357-40dbc57cc892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:14.967776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951391a9-0b89-4255-9357-40dbc57cc892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:14.967776 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951391a9-0b89-4255-9357-40dbc57cc892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:14.968753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951391a9-0b89-4255-9357-40dbc57cc892 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:14.980684 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1421/2849] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:14.985280 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:14.997416 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d9c9-64c7-45ae-a4e6-b37d8600caf2 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:15.005281 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:15.005948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.006242 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.006499 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] PATH_INFO: `/v3/projects/9554f5360dcf4b1483a4a46d61ec5db1/users/9b8679afc27c447f8167e15ce90f148d/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.023314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9554f5360dcf4b1483a4a46d61ec5db1, user_id=9b8679afc27c447f8167e15ce90f148d, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:15.026039 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:15.118309 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1429/2850] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:14 2022] PUT /identity/v3/projects/9554f5360dcf4b1483a4a46d61ec5db1/users/9b8679afc27c447f8167e15ce90f148d/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:15.129648 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bf8e5-f89e-4e38-91cb-7fd317e66439 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.129996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bf8e5-f89e-4e38-91cb-7fd317e66439 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.130275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bf8e5-f89e-4e38-91cb-7fd317e66439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.161117 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-938bf8e5-f89e-4e38-91cb-7fd317e66439 None None] MFA Rules not processed for user `9b8679afc27c447f8167e15ce90f148d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:15.162376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-938bf8e5-f89e-4e38-91cb-7fd317e66439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:15.227701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1422/2851] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:15.232294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:15.238301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:15.299300 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a1540-82d5-427c-9ed6-4aa38f4e059a admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:15.304125 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:15.304641 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.304925 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.305200 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.305852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:15.307792 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:15.416701 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1430/2852] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:15 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:15.420754 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bf8e5-f89e-4e38-91cb-7fd317e66439 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:15.431843 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bf8e5-f89e-4e38-91cb-7fd317e66439 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:15.489406 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:15.490023 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.490379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.490613 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.491243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:15.493251 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:15.501275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:15.593279 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1423/2853] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:15 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:15.594492 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:15.605252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119cce-8736-4b64-aa4f-6d09cb6e8736 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:15.610023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:15.610656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.610941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.611221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.611904 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:15.613497 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:15.624056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1431/2854] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:15.628283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:15.639534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb42ac4-49ac-4335-8089-ce978438cf1d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:15.644285 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:15.645564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.645847 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.646125 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] PATH_INFO: `/v3/projects/36cb45e6692a44e79baf996001dc6997/users/822361d699cb45e2a3bd2efe80e87eac/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.661123 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cb45e6692a44e79baf996001dc6997, user_id=822361d699cb45e2a3bd2efe80e87eac, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:15.663808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:15.775787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1424/2855] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:15 2022] PUT /identity/v3/projects/36cb45e6692a44e79baf996001dc6997/users/822361d699cb45e2a3bd2efe80e87eac/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:15.779920 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:15.790628 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf8af2-0549-4582-b9c2-0336fceba9f4 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:15.849576 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b476a9-2850-44db-bc7a-27a4414b7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:15.850054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b476a9-2850-44db-bc7a-27a4414b7667 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.850365 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b476a9-2850-44db-bc7a-27a4414b7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.850643 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b476a9-2850-44db-bc7a-27a4414b7667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.851286 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b476a9-2850-44db-bc7a-27a4414b7667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:15.852914 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b476a9-2850-44db-bc7a-27a4414b7667 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:15.863425 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1432/2856] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 12:51:15.867987 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:15.879162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f339aa-7fd9-46af-a146-dc1b8e07a288 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:15.884821 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:15.885490 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.885772 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.886047 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] PATH_INFO: `/v3/projects/36cb45e6692a44e79baf996001dc6997/users/822361d699cb45e2a3bd2efe80e87eac/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.889044 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cb45e6692a44e79baf996001dc6997, user_id=822361d699cb45e2a3bd2efe80e87eac, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:15.892259 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:15.903685 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1425/2857] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:15 2022] PUT /identity/v3/projects/36cb45e6692a44e79baf996001dc6997/users/822361d699cb45e2a3bd2efe80e87eac/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:15.916004 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0911-44a2-4d84-b7e1-5dd05e971335 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:15.916323 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0911-44a2-4d84-b7e1-5dd05e971335 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:15.916720 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0911-44a2-4d84-b7e1-5dd05e971335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:15.946908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7bea0911-44a2-4d84-b7e1-5dd05e971335 None None] MFA Rules not processed for user `822361d699cb45e2a3bd2efe80e87eac`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:15.948188 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7bea0911-44a2-4d84-b7e1-5dd05e971335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:16.013771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:16.017502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1433/2858] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:16.029638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:16.031394 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:16.091598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71e631-17a9-4607-a6c2-a930fe83c536 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:16.095332 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eccbcd-eccb-4a7c-93ab-f4cb69a0c9ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:16.095969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eccbcd-eccb-4a7c-93ab-f4cb69a0c9ef service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:16.096243 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eccbcd-eccb-4a7c-93ab-f4cb69a0c9ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:16.096510 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eccbcd-eccb-4a7c-93ab-f4cb69a0c9ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:16.115440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eccbcd-eccb-4a7c-93ab-f4cb69a0c9ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:16.115440 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eccbcd-eccb-4a7c-93ab-f4cb69a0c9ef service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:16.123898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1426/2859] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 12:51:19.164926 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0911-44a2-4d84-b7e1-5dd05e971335 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:19.228107 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0911-44a2-4d84-b7e1-5dd05e971335 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:19.232674 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:19.233294 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:19.233575 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:19.233847 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] PATH_INFO: `/v3/users/9b8679afc27c447f8167e15ce90f148d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:19.234976 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8679afc27c447f8167e15ce90f148d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:19.236935 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:19.382736 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8679afc27c447f8167e15ce90f148d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:19.383511 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8679afc27c447f8167e15ce90f148d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:19.390731 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8679afc27c447f8167e15ce90f148d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:19.403460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8679afc27c447f8167e15ce90f148d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:19.465899 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8679afc27c447f8167e15ce90f148d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:19.472221 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1434/2860] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:19 2022] DELETE /identity/v3/users/9b8679afc27c447f8167e15ce90f148d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:19.476801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:19.477305 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:19.477431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:19.496975 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:19.498162 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:19.556766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1427/2861] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:19.566661 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:19.568102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:19.626808 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35b1ff-c78c-4281-b9c2-3ae9fc5a1bcd admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:19.630388 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:19.630986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:19.631261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:19.631559 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:19.641594 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:19.642936 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:19.652318 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1435/2862] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:20.065115 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:20.066777 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:20.079090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11e95-269a-471b-89d5-524368685ce4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:20.085317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:20.086018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:20.086452 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:20.086737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] PATH_INFO: `/v3/projects/9554f5360dcf4b1483a4a46d61ec5db1` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:20.088210 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9554f5360dcf4b1483a4a46d61ec5db1)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:20.091473 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:20.215933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9554f5360dcf4b1483a4a46d61ec5db1', 'request_id': 'req-9aee407d-3c4a-4c86-b93f-43750b198a7d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.217609 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:20.311224 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9554f5360dcf4b1483a4a46d61ec5db1', 'request_id': 'req-9aee407d-3c4a-4c86-b93f-43750b198a7d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.317796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9554f5360dcf4b1483a4a46d61ec5db1', 'request_id': 'req-9aee407d-3c4a-4c86-b93f-43750b198a7d'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.329517 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] The token cache is being invalidate because project 9554f5360dcf4b1483a4a46d61ec5db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:20.329808 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.330487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.332002 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1428/2863] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:20 2022] DELETE /identity/v3/projects/9554f5360dcf4b1483a4a46d61ec5db1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:20.336670 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:20.346456 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d4ac8-9ec3-4626-9f11-8691a25269b0 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:20.365230 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:20.404263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:20.404893 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:20.405176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:20.405451 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] PATH_INFO: `/v3/users/822361d699cb45e2a3bd2efe80e87eac` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:20.406589 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822361d699cb45e2a3bd2efe80e87eac)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:20.408864 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:20.694422 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822361d699cb45e2a3bd2efe80e87eac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.695611 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822361d699cb45e2a3bd2efe80e87eac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.703056 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822361d699cb45e2a3bd2efe80e87eac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.715880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822361d699cb45e2a3bd2efe80e87eac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.794799 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-2312ae5d-b2f6-4292-8d7a-054a1f740cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822361d699cb45e2a3bd2efe80e87eac'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:20.801393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1436/2864] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:20 2022] DELETE /identity/v3/users/822361d699cb45e2a3bd2efe80e87eac => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:21.284832 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:21.287075 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:21.300247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee407d-3c4a-4c86-b93f-43750b198a7d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:21.363358 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:21.364005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:21.364283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:21.364541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] PATH_INFO: `/v3/projects/36cb45e6692a44e79baf996001dc6997` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:21.365660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cb45e6692a44e79baf996001dc6997)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:21.368356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:21.496110 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cb45e6692a44e79baf996001dc6997', 'request_id': 'req-d678361d-07a4-4faa-b837-01f463575865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:21.563042 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cb45e6692a44e79baf996001dc6997', 'request_id': 'req-d678361d-07a4-4faa-b837-01f463575865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:21.569552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cb45e6692a44e79baf996001dc6997', 'request_id': 'req-d678361d-07a4-4faa-b837-01f463575865'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:21.581886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] The token cache is being invalidate because project 36cb45e6692a44e79baf996001dc6997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:21.582257 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:21.582912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d678361d-07a4-4faa-b837-01f463575865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:21.584429 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1429/2865] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:21 2022] DELETE /identity/v3/projects/36cb45e6692a44e79baf996001dc6997 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:21.589478 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ff7e-e500-4142-8e4e-17665a745f7a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:21.589999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ff7e-e500-4142-8e4e-17665a745f7a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:21.590098 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ff7e-e500-4142-8e4e-17665a745f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:21.610152 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4cd2ff7e-e500-4142-8e4e-17665a745f7a None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:21.611366 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4cd2ff7e-e500-4142-8e4e-17665a745f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:21.671660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1437/2866] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:21.680338 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c6e6-866b-4357-9e96-8139f57b356f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:21.680564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c6e6-866b-4357-9e96-8139f57b356f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:21.680766 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c6e6-866b-4357-9e96-8139f57b356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:21.700212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-0a98c6e6-866b-4357-9e96-8139f57b356f None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:21.701392 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0a98c6e6-866b-4357-9e96-8139f57b356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:21.709150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1430/2867] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:21.713924 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ff7e-e500-4142-8e4e-17665a745f7a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:21.724215 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ff7e-e500-4142-8e4e-17665a745f7a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:21.729593 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:21.730189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:21.730466 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:21.730758 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:21.731437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:51:21.731744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:21.733334 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:21.745099 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1438/2868] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:51:21.749407 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98c6e6-866b-4357-9e96-8139f57b356f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:21.758833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98c6e6-866b-4357-9e96-8139f57b356f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:21.764169 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:21.764779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:21.765061 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:21.765355 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:21.766006 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:21.767946 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:21.881962 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1431/2869] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:21 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:21.886558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:21.896521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db745-7a95-4149-bb01-77666a83f178 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:21.923229 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:21.961120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:21.961903 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:21.962205 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:21.962472 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:21.963227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:21.965224 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.032034 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1439/2870] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:21 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:22.035936 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.047059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67672e13-bcb7-4c73-8b12-525fe3e0a3f8 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.051833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.052449 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.052729 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.053004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.053654 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.055522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.066196 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1432/2871] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:22.070776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.081370 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256f0aa-a6f6-44fd-8902-1400c543f612 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.087429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea04cc0-4562-449f-a26e-37d8ea157c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.088050 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04cc0-4562-449f-a26e-37d8ea157c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.088328 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04cc0-4562-449f-a26e-37d8ea157c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.088598 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea04cc0-4562-449f-a26e-37d8ea157c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.089249 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04cc0-4562-449f-a26e-37d8ea157c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.090857 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea04cc0-4562-449f-a26e-37d8ea157c7b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.102177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1440/2872] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:22.106322 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.116589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55905f-a671-44f8-be15-034ab3e566dc admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.123245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.123945 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.124223 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.124497 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] PATH_INFO: `/v3/projects/e16125a00d79471aa1b95e8216b90a4a/users/133d0da57520415b962ee3c32bf13914/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.141579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16125a00d79471aa1b95e8216b90a4a, user_id=133d0da57520415b962ee3c32bf13914, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.144167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.220463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1433/2873] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:22 2022] PUT /identity/v3/projects/e16125a00d79471aa1b95e8216b90a4a/users/133d0da57520415b962ee3c32bf13914/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:22.231261 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147603-0da9-417c-ba7b-e08590ad70a9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.231581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147603-0da9-417c-ba7b-e08590ad70a9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.231853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab147603-0da9-417c-ba7b-e08590ad70a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.261639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ab147603-0da9-417c-ba7b-e08590ad70a9 None None] MFA Rules not processed for user `133d0da57520415b962ee3c32bf13914`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:22.262862 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ab147603-0da9-417c-ba7b-e08590ad70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:22.341604 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1441/2874] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:22.345769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.352064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:22.409354 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159804e-e538-4b9b-982b-662ef80b7deb admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.414086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.414663 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.414939 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.415207 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.415864 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.417745 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.517670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1434/2875] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:22 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:22.521902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab147603-0da9-417c-ba7b-e08590ad70a9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.533588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab147603-0da9-417c-ba7b-e08590ad70a9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.603910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.604660 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.604776 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.605027 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.605654 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.607574 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.694946 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1442/2876] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:22 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:22.699482 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.709860 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837d1e-3b53-46cf-83bb-cdda888f67ed admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.714651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.715252 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.715551 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.715823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.716580 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.718209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.728852 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1435/2877] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:22.732991 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.743652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d32c90-3ed0-4bec-9629-3feca8bad4a5 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.748234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.748874 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.749150 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.749417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] PATH_INFO: `/v3/projects/7455c00b9d7a4d5584eebb0fec4d9300/users/451d51be19e8472c9391bed709bd7c3d/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.768228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7455c00b9d7a4d5584eebb0fec4d9300, user_id=451d51be19e8472c9391bed709bd7c3d, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.771295 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.846514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1443/2878] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:22 2022] PUT /identity/v3/projects/7455c00b9d7a4d5584eebb0fec4d9300/users/451d51be19e8472c9391bed709bd7c3d/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 12:51:22.850598 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.861448 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04408f3-7236-41a8-82a6-f2166ff93747 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.918180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048fb49-d2b2-45e8-a3db-e0ac8f81b3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.918795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048fb49-d2b2-45e8-a3db-e0ac8f81b3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.919112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048fb49-d2b2-45e8-a3db-e0ac8f81b3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.919413 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048fb49-d2b2-45e8-a3db-e0ac8f81b3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.920080 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048fb49-d2b2-45e8-a3db-e0ac8f81b3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.921675 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048fb49-d2b2-45e8-a3db-e0ac8f81b3a2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.932309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1436/2879] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:22.936690 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:22.942184 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:22.947947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b5395-2f18-4805-b237-683f573bcc09 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:22.958644 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:22.959386 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:22.961493 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:22.961728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] PATH_INFO: `/v3/projects/7455c00b9d7a4d5584eebb0fec4d9300/users/451d51be19e8472c9391bed709bd7c3d/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:22.963849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7455c00b9d7a4d5584eebb0fec4d9300, user_id=451d51be19e8472c9391bed709bd7c3d, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:22.966536 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:22.980749 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1444/2880] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:22 2022] PUT /identity/v3/projects/7455c00b9d7a4d5584eebb0fec4d9300/users/451d51be19e8472c9391bed709bd7c3d/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:23.047308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabee4-94d1-423e-924c-a21916255062 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:23.047640 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabee4-94d1-423e-924c-a21916255062 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:23.047924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aabee4-94d1-423e-924c-a21916255062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:23.077876 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-58aabee4-94d1-423e-924c-a21916255062 None None] MFA Rules not processed for user `451d51be19e8472c9391bed709bd7c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:23.079112 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-58aabee4-94d1-423e-924c-a21916255062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:23.147859 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:23.151780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1437/2881] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:23.162369 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:23.164665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:23.227426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10f0c-41bb-4e30-bd42-04fdad0c62cf admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:23.231106 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:23.231804 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:23.232087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:23.232357 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:23.241431 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:23.243514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:23.253042 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1445/2882] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:23.375164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabee4-94d1-423e-924c-a21916255062 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:23.385666 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aabee4-94d1-423e-924c-a21916255062 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:23.389227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eacff-d257-4329-adb7-979df4a28eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:23.389820 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eacff-d257-4329-adb7-979df4a28eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:23.390091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eacff-d257-4329-adb7-979df4a28eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:23.390357 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eacff-d257-4329-adb7-979df4a28eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:23.448286 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eacff-d257-4329-adb7-979df4a28eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:23.449697 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eacff-d257-4329-adb7-979df4a28eb6 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:23.458618 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1438/2883] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:26.576314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:26.643877 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e736a-7283-452b-b1ee-061f7e2d20dc service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:26.649385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:26.650277 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:26.650583 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:26.650885 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] PATH_INFO: `/v3/users/133d0da57520415b962ee3c32bf13914` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:26.652100 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=133d0da57520415b962ee3c32bf13914)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:26.654096 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:26.918886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133d0da57520415b962ee3c32bf13914'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:26.919605 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133d0da57520415b962ee3c32bf13914'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:26.926724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133d0da57520415b962ee3c32bf13914'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:26.939616 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133d0da57520415b962ee3c32bf13914'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:27.071706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133d0da57520415b962ee3c32bf13914'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:27.078971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1446/2884] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:26 2022] DELETE /identity/v3/users/133d0da57520415b962ee3c32bf13914 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:27.083475 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:27.083956 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:27.084093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:27.104402 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:27.105626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:27.169105 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1439/2885] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:27.178979 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:27.181714 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:27.194956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:27.239029 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fc5cd-f963-4872-ac6b-387afb5be35f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:27.243089 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:27.244032 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:27.244757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:27.244757 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:27.253726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:27.255176 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:27.265014 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1447/2886] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:27.700056 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:27.701670 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:27.716809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b137a-d8c8-4c1c-ac15-cc8381a47fa8 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:27.721734 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:27.724491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:27.724491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:27.724491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] PATH_INFO: `/v3/projects/e16125a00d79471aa1b95e8216b90a4a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:27.724491 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16125a00d79471aa1b95e8216b90a4a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:27.726151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:27.846674 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16125a00d79471aa1b95e8216b90a4a', 'request_id': 'req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:27.920796 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16125a00d79471aa1b95e8216b90a4a', 'request_id': 'req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:27.927247 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16125a00d79471aa1b95e8216b90a4a', 'request_id': 'req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:27.939181 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] The token cache is being invalidate because project e16125a00d79471aa1b95e8216b90a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:27.939572 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:27.940249 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:27.941737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1440/2887] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:27 2022] DELETE /identity/v3/projects/e16125a00d79471aa1b95e8216b90a4a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:27.946502 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:27.956546 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcebb7c-0041-4e73-bde7-a99772add291 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:28.017051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:28.017759 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:28.017956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:28.018232 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] PATH_INFO: `/v3/users/451d51be19e8472c9391bed709bd7c3d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:28.019399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=451d51be19e8472c9391bed709bd7c3d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:28.021316 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:28.194870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451d51be19e8472c9391bed709bd7c3d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:28.195571 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451d51be19e8472c9391bed709bd7c3d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:28.202515 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451d51be19e8472c9391bed709bd7c3d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:28.220012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451d51be19e8472c9391bed709bd7c3d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:28.311265 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0ea74e1c-29c4-44ea-a71f-4ef7868a1dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451d51be19e8472c9391bed709bd7c3d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:28.317860 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1448/2888] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:27 2022] DELETE /identity/v3/users/451d51be19e8472c9391bed709bd7c3d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:28.780149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:28.784399 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:28.796034 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd4fc3-526e-4362-bfc0-ee242d2d77e7 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:28.817817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:28.857829 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:28.858471 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:28.858753 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:28.859035 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] PATH_INFO: `/v3/projects/7455c00b9d7a4d5584eebb0fec4d9300` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:28.860227 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7455c00b9d7a4d5584eebb0fec4d9300)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:28.862167 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:28.945835 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7455c00b9d7a4d5584eebb0fec4d9300', 'request_id': 'req-09df2b50-0306-4d30-827b-32cc4b2c21b8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:29.002364 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7455c00b9d7a4d5584eebb0fec4d9300', 'request_id': 'req-09df2b50-0306-4d30-827b-32cc4b2c21b8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:29.008992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7455c00b9d7a4d5584eebb0fec4d9300', 'request_id': 'req-09df2b50-0306-4d30-827b-32cc4b2c21b8'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:29.020885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] The token cache is being invalidate because project 7455c00b9d7a4d5584eebb0fec4d9300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:29.021288 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:29.021969 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-09df2b50-0306-4d30-827b-32cc4b2c21b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:29.023547 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1441/2889] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:28 2022] DELETE /identity/v3/projects/7455c00b9d7a4d5584eebb0fec4d9300 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:29.029235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5520342-cdf2-4bdb-8204-3b9ec43ac204 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.031426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5520342-cdf2-4bdb-8204-3b9ec43ac204 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.031426 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5520342-cdf2-4bdb-8204-3b9ec43ac204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.049955 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e5520342-cdf2-4bdb-8204-3b9ec43ac204 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:29.051159 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e5520342-cdf2-4bdb-8204-3b9ec43ac204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:29.083252 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:29.113967 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1449/2890] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:29.122004 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586891b7-58dc-4957-a11e-efc6d73fdfa2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.122323 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586891b7-58dc-4957-a11e-efc6d73fdfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.123254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586891b7-58dc-4957-a11e-efc6d73fdfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.145226 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-586891b7-58dc-4957-a11e-efc6d73fdfa2 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:29.146463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-586891b7-58dc-4957-a11e-efc6d73fdfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:29.155089 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1442/2891] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:29.159421 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5520342-cdf2-4bdb-8204-3b9ec43ac204 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.168948 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5520342-cdf2-4bdb-8204-3b9ec43ac204 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:29.173521 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:29.174345 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.174894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.175193 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.176260 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:51:29.176577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:29.178218 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:29.191192 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1450/2892] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:51:29.195519 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586891b7-58dc-4957-a11e-efc6d73fdfa2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.205974 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586891b7-58dc-4957-a11e-efc6d73fdfa2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:29.210825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:29.211450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.211799 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.212150 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.212900 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:29.214798 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:29.307607 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1443/2893] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:29 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:29.311801 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.322873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac63a0-500e-49a2-8c0a-303f911e3981 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:29.379552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:29.380178 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.380458 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.380728 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.381393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:29.383320 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:29.465883 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1451/2894] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:29 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:29.470086 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.480826 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bfad8-9ad3-4b69-be7d-2c73cd8ee312 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:29.485660 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:29.486265 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.486546 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.486906 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.487591 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:29.489188 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:29.499865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1444/2895] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:29.504236 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.516213 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fedb92-32b5-4f55-81f5-3ab8e4ba7218 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:29.520850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a7197-dcbf-4d82-a3c8-237061c90b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:29.521441 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7197-dcbf-4d82-a3c8-237061c90b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.521717 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7197-dcbf-4d82-a3c8-237061c90b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.521987 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a7197-dcbf-4d82-a3c8-237061c90b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.522624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a7197-dcbf-4d82-a3c8-237061c90b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:29.524234 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a7197-dcbf-4d82-a3c8-237061c90b09 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:29.534898 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1452/2896] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:29.539424 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.550194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ec573-9e11-4cdf-9853-7baabdec628e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:29.555012 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:29.556327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.556611 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.556886 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] PATH_INFO: `/v3/projects/3254c8f0a90144a6b064e132f769bc37/users/32a350623a0244a38b5b69a17ddee796/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.571743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3254c8f0a90144a6b064e132f769bc37, user_id=32a350623a0244a38b5b69a17ddee796, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:29.574361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:29.670128 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1445/2897] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:29 2022] PUT /identity/v3/projects/3254c8f0a90144a6b064e132f769bc37/users/32a350623a0244a38b5b69a17ddee796/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:29.682429 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3d9d-ef38-4992-ad5e-6057e768ec11 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.682712 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3d9d-ef38-4992-ad5e-6057e768ec11 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.682985 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3d9d-ef38-4992-ad5e-6057e768ec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.711008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1a2c3d9d-ef38-4992-ad5e-6057e768ec11 None None] MFA Rules not processed for user `32a350623a0244a38b5b69a17ddee796`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:29.712371 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1a2c3d9d-ef38-4992-ad5e-6057e768ec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:29.777645 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1453/2898] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:29.782141 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.832423 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:29.845628 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de904f-6fe1-4d05-92a4-2d5d39a7d7ad admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:29.850303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:29.852682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:29.852682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:29.852682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:29.852682 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:29.854971 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:29.964644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1446/2899] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:29 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:29.968704 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3d9d-ef38-4992-ad5e-6057e768ec11 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:29.979940 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3d9d-ef38-4992-ad5e-6057e768ec11 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:30.006786 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:30.042274 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:30.042983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:30.043149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:30.043494 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:30.044148 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:30.046083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:30.160969 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1454/2900] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:29 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:30.165823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:30.176343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132975bf-b7ca-45cc-a14a-ec50dbb6625d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:30.181137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:30.181740 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:30.182016 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:30.182287 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:30.182978 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:30.184615 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:30.194749 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1447/2901] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:30.199617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:30.210085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cdfde-c5d3-4a46-b756-8dfa2819e007 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:30.215189 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:30.215871 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:30.216202 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:30.216477 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] PATH_INFO: `/v3/projects/20e48712c3fc4a62a4fba34f99161303/users/84048c16e4f947bdb781a35d36d1ced7/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:30.235552 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e48712c3fc4a62a4fba34f99161303, user_id=84048c16e4f947bdb781a35d36d1ced7, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:30.238258 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:30.323385 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1455/2902] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:30 2022] PUT /identity/v3/projects/20e48712c3fc4a62a4fba34f99161303/users/84048c16e4f947bdb781a35d36d1ced7/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:30.327382 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:30.338091 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03abf1-3449-4dbe-aed7-1f2566cff06e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:30.401885 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801be4ba-b0b7-44e6-952b-c0bf59730471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:30.402504 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801be4ba-b0b7-44e6-952b-c0bf59730471 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:30.402787 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801be4ba-b0b7-44e6-952b-c0bf59730471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:30.403059 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801be4ba-b0b7-44e6-952b-c0bf59730471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:30.403992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801be4ba-b0b7-44e6-952b-c0bf59730471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:30.405579 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801be4ba-b0b7-44e6-952b-c0bf59730471 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:30.418981 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1448/2903] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:30.423629 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:30.433825 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6cbb0-062a-4b03-b539-1879bd96fe5f admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:30.438468 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:30.439105 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:30.439410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:30.439683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] PATH_INFO: `/v3/projects/20e48712c3fc4a62a4fba34f99161303/users/84048c16e4f947bdb781a35d36d1ced7/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:30.441744 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e48712c3fc4a62a4fba34f99161303, user_id=84048c16e4f947bdb781a35d36d1ced7, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:30.444434 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:30.455631 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1456/2904] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:30 2022] PUT /identity/v3/projects/20e48712c3fc4a62a4fba34f99161303/users/84048c16e4f947bdb781a35d36d1ced7/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:30.466770 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6b9c-3f1c-4887-a7c2-9a4457f51087 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:30.467094 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6b9c-3f1c-4887-a7c2-9a4457f51087 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:30.467397 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6b9c-3f1c-4887-a7c2-9a4457f51087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:30.494903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a80a6b9c-3f1c-4887-a7c2-9a4457f51087 None None] MFA Rules not processed for user `84048c16e4f947bdb781a35d36d1ced7`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:30.496155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a80a6b9c-3f1c-4887-a7c2-9a4457f51087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:30.564919 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1449/2905] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:30.576384 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:30.578055 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:30.636044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ab7b-b6e8-4793-b47b-f6abc2d4bf52 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:30.639737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35da1b8-795f-4a08-9ed6-33a4a4e0ec2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:30.640344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da1b8-795f-4a08-9ed6-33a4a4e0ec2d service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:30.640619 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da1b8-795f-4a08-9ed6-33a4a4e0ec2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:30.640894 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da1b8-795f-4a08-9ed6-33a4a4e0ec2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:30.704374 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35da1b8-795f-4a08-9ed6-33a4a4e0ec2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:30.705737 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35da1b8-795f-4a08-9ed6-33a4a4e0ec2d service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:30.715072 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1457/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:33.735320 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6b9c-3f1c-4887-a7c2-9a4457f51087 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:33.783352 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:33.800390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6b9c-3f1c-4887-a7c2-9a4457f51087 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:33.805303 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:33.805933 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:33.806216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:33.806564 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] PATH_INFO: `/v3/users/32a350623a0244a38b5b69a17ddee796` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:33.807856 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a350623a0244a38b5b69a17ddee796)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:33.809823 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:34.002846 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a350623a0244a38b5b69a17ddee796'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:34.065316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a350623a0244a38b5b69a17ddee796'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:34.079159 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a350623a0244a38b5b69a17ddee796'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:34.079889 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a350623a0244a38b5b69a17ddee796'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:34.087276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a350623a0244a38b5b69a17ddee796'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:34.093345 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1450/2907] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:33 2022] DELETE /identity/v3/users/32a350623a0244a38b5b69a17ddee796 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:34.097968 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:34.105219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:34.105219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:34.118474 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:34.119723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:34.152146 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:34.180624 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1458/2908] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:34.191194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:34.192659 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:34.251267 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a43779-db02-48a5-98c7-744556c01c41 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:34.255093 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:34.255785 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:34.256070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:34.256340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:34.270878 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:34.272431 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:34.283065 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1451/2909] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:34.947761 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:34.949203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:34.962301 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdd666-01e4-47d8-b610-a75e57b5c23c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:34.972581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:34.972581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:34.972581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:34.972581 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] PATH_INFO: `/v3/projects/3254c8f0a90144a6b064e132f769bc37` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:34.973399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3254c8f0a90144a6b064e132f769bc37)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:34.973399 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:35.099329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3254c8f0a90144a6b064e132f769bc37', 'request_id': 'req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.202648 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3254c8f0a90144a6b064e132f769bc37', 'request_id': 'req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.208915 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3254c8f0a90144a6b064e132f769bc37', 'request_id': 'req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.220880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] The token cache is being invalidate because project 3254c8f0a90144a6b064e132f769bc37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:35.221174 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.221829 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.223679 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1459/2910] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:34 2022] DELETE /identity/v3/projects/3254c8f0a90144a6b064e132f769bc37 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:35.227509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:35.237769 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309750c9-de38-43f4-8222-9e5f37d965ad service neutron] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:35.295644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:35.296275 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:35.296554 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:35.296827 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] PATH_INFO: `/v3/users/84048c16e4f947bdb781a35d36d1ced7` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:35.298005 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84048c16e4f947bdb781a35d36d1ced7)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:35.299964 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:35.305489 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:35.465701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84048c16e4f947bdb781a35d36d1ced7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.543308 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84048c16e4f947bdb781a35d36d1ced7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.556319 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84048c16e4f947bdb781a35d36d1ced7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.556992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84048c16e4f947bdb781a35d36d1ced7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.564817 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-0b90e45d-c122-4e3a-81e2-1857455b1e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84048c16e4f947bdb781a35d36d1ced7'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:35.571430 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1452/2911] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:35 2022] DELETE /identity/v3/users/84048c16e4f947bdb781a35d36d1ced7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:36.027651 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:36.029880 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:36.043177 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b7b48-163d-4e0c-8bd5-3c842e84042e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:36.104047 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:36.104710 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.104949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.105222 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] PATH_INFO: `/v3/projects/20e48712c3fc4a62a4fba34f99161303` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.106377 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e48712c3fc4a62a4fba34f99161303)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:36.108834 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:36.238292 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e48712c3fc4a62a4fba34f99161303', 'request_id': 'req-091cf40e-c6a7-4088-9cde-24d5d72309f3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:36.314557 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e48712c3fc4a62a4fba34f99161303', 'request_id': 'req-091cf40e-c6a7-4088-9cde-24d5d72309f3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:36.318886 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:36.321706 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e48712c3fc4a62a4fba34f99161303', 'request_id': 'req-091cf40e-c6a7-4088-9cde-24d5d72309f3'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:36.334551 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] The token cache is being invalidate because project 20e48712c3fc4a62a4fba34f99161303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:36.334841 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:36.335527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-091cf40e-c6a7-4088-9cde-24d5d72309f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:36.337122 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1460/2912] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:36 2022] DELETE /identity/v3/projects/20e48712c3fc4a62a4fba34f99161303 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:36.342703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a365993-6ac3-4254-a441-ca3ae872ead7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.343194 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a365993-6ac3-4254-a441-ca3ae872ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.343314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a365993-6ac3-4254-a441-ca3ae872ead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.363552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9a365993-6ac3-4254-a441-ca3ae872ead7 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:36.364744 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a365993-6ac3-4254-a441-ca3ae872ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:36.425635 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1453/2913] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:36.433558 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c774b-2305-40e5-8125-a3e7371445f0 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.433849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c774b-2305-40e5-8125-a3e7371445f0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.434130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c774b-2305-40e5-8125-a3e7371445f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.454194 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bd3c774b-2305-40e5-8125-a3e7371445f0 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:36.457442 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bd3c774b-2305-40e5-8125-a3e7371445f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:36.464325 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1461/2914] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:36.469333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a365993-6ac3-4254-a441-ca3ae872ead7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:36.478963 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a365993-6ac3-4254-a441-ca3ae872ead7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:36.484356 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:36.484991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.485317 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.485589 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.486232 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:51:36.486530 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:36.488155 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:36.499583 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1454/2915] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 12:51:36.503872 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c774b-2305-40e5-8125-a3e7371445f0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:36.513241 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c774b-2305-40e5-8125-a3e7371445f0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:36.518044 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:36.518630 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.518906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.519175 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.519849 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:36.521738 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:36.644764 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1462/2916] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:36 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:36.648991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:36.659891 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e373b-3adb-4c7f-a7eb-26430fed5322 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:36.722272 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:36.722892 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.723173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.723488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.724135 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:36.726055 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:36.843450 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1455/2917] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:36 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:36.847613 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:36.858902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f3fa7-355b-4c04-b299-65944c5d2bcb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:36.863601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:36.864214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.864495 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.864770 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.865420 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:36.867023 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:36.878905 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1463/2918] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:36.883049 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:36.889299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:36.894949 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd496bd-83d9-4840-bc0a-c56f5d6c8165 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:36.899608 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd812e-1543-4f94-95df-3df82f59d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:36.900216 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd812e-1543-4f94-95df-3df82f59d326 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.900496 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd812e-1543-4f94-95df-3df82f59d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.900771 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd812e-1543-4f94-95df-3df82f59d326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.901414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd812e-1543-4f94-95df-3df82f59d326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:36.903009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd812e-1543-4f94-95df-3df82f59d326 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:36.914518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1456/2919] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:36.918755 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:36.929393 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cb0cb-c6fa-45d6-a7ef-f9d33440541b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:36.934253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:36.934908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:36.935779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:36.936198 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] PATH_INFO: `/v3/projects/086fc0abd01845dba65f44f5a205acdf/users/97cdfd60face424c881e0d8b6df23828/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:36.953356 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=086fc0abd01845dba65f44f5a205acdf, user_id=97cdfd60face424c881e0d8b6df23828, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:36.956063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:37.042351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1464/2920] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:36 2022] PUT /identity/v3/projects/086fc0abd01845dba65f44f5a205acdf/users/97cdfd60face424c881e0d8b6df23828/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:37.053865 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1974ad-f49c-4c78-8db0-1b8a6023c596 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:37.054151 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1974ad-f49c-4c78-8db0-1b8a6023c596 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:37.054426 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1974ad-f49c-4c78-8db0-1b8a6023c596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:37.085190 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9c1974ad-f49c-4c78-8db0-1b8a6023c596 None None] MFA Rules not processed for user `97cdfd60face424c881e0d8b6df23828`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:37.086417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9c1974ad-f49c-4c78-8db0-1b8a6023c596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:37.154570 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1457/2921] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:37.166003 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:37.167746 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:37.226781 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff57109-ae8f-4ec8-a7fe-1c33a1e6b7cc admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:37.230470 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cbab7-1ea0-4cf8-ae86-3249aa1b4537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:37.231069 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbab7-1ea0-4cf8-ae86-3249aa1b4537 service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:37.231362 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbab7-1ea0-4cf8-ae86-3249aa1b4537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:37.231663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbab7-1ea0-4cf8-ae86-3249aa1b4537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:37.240565 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cbab7-1ea0-4cf8-ae86-3249aa1b4537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:37.241981 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cbab7-1ea0-4cf8-ae86-3249aa1b4537 service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:37.250665 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1465/2922] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:47.150898 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=36 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:47.246709 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=1,keystone:SELECT=57,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:55.211927 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1974ad-f49c-4c78-8db0-1b8a6023c596 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:55.294173 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1974ad-f49c-4c78-8db0-1b8a6023c596 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:55.299233 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:55.299884 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:55.300245 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:55.300403 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] PATH_INFO: `/v3/users/97cdfd60face424c881e0d8b6df23828` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:55.301513 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cdfd60face424c881e0d8b6df23828)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:55.303437 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:55.478361 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cdfd60face424c881e0d8b6df23828'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:55.521603 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cdfd60face424c881e0d8b6df23828'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:55.534795 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cdfd60face424c881e0d8b6df23828'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:55.538149 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cdfd60face424c881e0d8b6df23828'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:55.542644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cdfd60face424c881e0d8b6df23828'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:55.550696 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1458/2923] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:51:55 2022] DELETE /identity/v3/users/97cdfd60face424c881e0d8b6df23828 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:55.555263 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:55.559486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:55.559486 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:55.587010 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:55.588311 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:55.646796 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1466/2924] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:55.656743 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:55.659014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:55.715973 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4817-0176-4b31-9d3c-acd2593c1c18 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:55.719626 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ab97d-be6c-4618-ba94-aca7d10bc86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:55.720762 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ab97d-be6c-4618-ba94-aca7d10bc86b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:55.721033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ab97d-be6c-4618-ba94-aca7d10bc86b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:55.721299 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ab97d-be6c-4618-ba94-aca7d10bc86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:55.730327 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ab97d-be6c-4618-ba94-aca7d10bc86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:55.731711 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ab97d-be6c-4618-ba94-aca7d10bc86b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:55.741991 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1459/2925] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:51:56.209941 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:56.211428 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:56.224078 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedee46-5909-430d-a5d7-1bfb49e08e70 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:56.230754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:56.230754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.230754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.230754 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] PATH_INFO: `/v3/projects/086fc0abd01845dba65f44f5a205acdf` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.231449 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086fc0abd01845dba65f44f5a205acdf)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:56.233364 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:56.330084 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086fc0abd01845dba65f44f5a205acdf', 'request_id': 'req-95e9130a-6e34-4baa-b982-87f79249fd32'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:56.384888 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086fc0abd01845dba65f44f5a205acdf', 'request_id': 'req-95e9130a-6e34-4baa-b982-87f79249fd32'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:56.390956 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086fc0abd01845dba65f44f5a205acdf', 'request_id': 'req-95e9130a-6e34-4baa-b982-87f79249fd32'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:56.402971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] The token cache is being invalidate because project 086fc0abd01845dba65f44f5a205acdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:51:56.403266 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:56.403944 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-95e9130a-6e34-4baa-b982-87f79249fd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:51:56.405501 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1467/2926] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:51:56 2022] DELETE /identity/v3/projects/086fc0abd01845dba65f44f5a205acdf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:56.410652 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d6df-67c4-4aaa-9eaf-4cca13fc2baf None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.411137 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d6df-67c4-4aaa-9eaf-4cca13fc2baf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.411264 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d6df-67c4-4aaa-9eaf-4cca13fc2baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.419645 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:56.430340 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cb01d6df-67c4-4aaa-9eaf-4cca13fc2baf None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:56.431587 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cb01d6df-67c4-4aaa-9eaf-4cca13fc2baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:56.490994 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1460/2927] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:56.503560 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eb583-8776-4831-988c-f02e70297216 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.503779 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eb583-8776-4831-988c-f02e70297216 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.504051 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eb583-8776-4831-988c-f02e70297216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.525601 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c93eb583-8776-4831-988c-f02e70297216 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:56.526818 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c93eb583-8776-4831-988c-f02e70297216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:56.534951 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1468/2928] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:56.539212 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01d6df-67c4-4aaa-9eaf-4cca13fc2baf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:56.548842 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01d6df-67c4-4aaa-9eaf-4cca13fc2baf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:56.553566 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:56.667311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.667311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.667311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.667311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 12:51:56.667311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:56.667311 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:56.667986 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1461/2929] 10.222.0.49 () {58 vars in 1153 bytes} [Mon Sep 26 12:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 12:51:56.668092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eb583-8776-4831-988c-f02e70297216 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:56.668092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eb583-8776-4831-988c-f02e70297216 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:56.668092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:56.668092 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.668852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.668852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.668852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:56.668852 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:56.705617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1469/2930] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:56 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:51:56.710209 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:56.720433 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ef71-abb5-4acd-a3b6-c11979e7ac83 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:56.780048 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:56.780534 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.780809 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.781081 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.781784 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:56.784568 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:56.870688 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1462/2931] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:56 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:56.875235 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:56.886844 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520f59-c61b-4239-b66c-d4bf5a9b39ed admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:56.892351 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:56.899771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.899771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.899771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.899771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:56.899771 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:56.906952 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1470/2932] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:56.912462 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:56.922390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077299e-fed8-4496-9077-4002a9c844aa admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:56.928518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c5493-4fed-492e-88d7-85f0a855b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:56.929197 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c5493-4fed-492e-88d7-85f0a855b71d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.929549 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c5493-4fed-492e-88d7-85f0a855b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.929881 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c5493-4fed-492e-88d7-85f0a855b71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.930779 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c5493-4fed-492e-88d7-85f0a855b71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:56.932518 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c5493-4fed-492e-88d7-85f0a855b71d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:56.944928 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1463/2933] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:56.950444 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:56.963199 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5c2b6-34d5-4d2e-9a10-f26e86ed19ae admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:56.967870 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:56.968527 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:56.968809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:56.969090 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] PATH_INFO: `/v3/projects/4449f37d67814de48e649e4c3e68d43e/users/ca45767a8c0d4838bf35e5d94bd92fa5/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:56.984861 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4449f37d67814de48e649e4c3e68d43e, user_id=ca45767a8c0d4838bf35e5d94bd92fa5, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:56.987906 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:57.071683 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1471/2934] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:56 2022] PUT /identity/v3/projects/4449f37d67814de48e649e4c3e68d43e/users/ca45767a8c0d4838bf35e5d94bd92fa5/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:57.084168 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9814c-1790-4e93-8f69-44f0845ff3d6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.084582 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9814c-1790-4e93-8f69-44f0845ff3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.084922 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9814c-1790-4e93-8f69-44f0845ff3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.112896 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bcb9814c-1790-4e93-8f69-44f0845ff3d6 None None] MFA Rules not processed for user `ca45767a8c0d4838bf35e5d94bd92fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:57.114095 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bcb9814c-1790-4e93-8f69-44f0845ff3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:57.177367 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:57.181033 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1464/2935] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:57.185850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:57.197203 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:57.249310 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e979a-49b4-4530-8945-4cfc4a5dba85 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:57.254850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:57.255514 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.255800 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.256079 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.256725 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:57.258783 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:57.374201 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1472/2936] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:57 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:57.379064 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9814c-1790-4e93-8f69-44f0845ff3d6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:57.390244 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9814c-1790-4e93-8f69-44f0845ff3d6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:57.447951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:57.448649 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.448833 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.449106 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.449735 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:57.451702 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:57.556576 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1465/2937] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:57 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:57.560577 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:57.571656 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b012bd-deac-45e0-834d-7319f46bdd2b admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:57.576344 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:57.577496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.577496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.577496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.578102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:57.579947 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:57.590437 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1473/2938] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:57.594341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:57.604314 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a6156-6b62-41d4-b917-fd73c7cfe073 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:57.608924 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e525c41-c115-4dff-be32-64ac3ca2761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:57.609522 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525c41-c115-4dff-be32-64ac3ca2761f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.609801 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525c41-c115-4dff-be32-64ac3ca2761f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.610073 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525c41-c115-4dff-be32-64ac3ca2761f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.611359 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e525c41-c115-4dff-be32-64ac3ca2761f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:57.612943 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e525c41-c115-4dff-be32-64ac3ca2761f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:57.623390 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1466/2939] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:57.628243 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:57.638824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5e819-9af7-4bfa-b27d-e43c9b7cabe3 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:57.643667 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:57.644317 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.644599 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.644873 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] PATH_INFO: `/v3/projects/4c12da657c16493aa87a0c960bebda7b/users/52394712bcba40c8a61dc614d840f4e6/roles/de5d8b924ce74b7d81747e8e0d91c075` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.659663 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c12da657c16493aa87a0c960bebda7b, user_id=52394712bcba40c8a61dc614d840f4e6, role_id=de5d8b924ce74b7d81747e8e0d91c075)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:57.662314 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:57.756902 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1474/2940] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:57 2022] PUT /identity/v3/projects/4c12da657c16493aa87a0c960bebda7b/users/52394712bcba40c8a61dc614d840f4e6/roles/de5d8b924ce74b7d81747e8e0d91c075 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:57.767703 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ace6f-e5d1-47d1-b368-6427884cd437 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.767996 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ace6f-e5d1-47d1-b368-6427884cd437 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.768280 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ace6f-e5d1-47d1-b368-6427884cd437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.797092 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-134ace6f-e5d1-47d1-b368-6427884cd437 None None] MFA Rules not processed for user `52394712bcba40c8a61dc614d840f4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:57.799281 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-134ace6f-e5d1-47d1-b368-6427884cd437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:57.865944 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1467/2941] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:57.870794 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:57.934615 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1d98d-9aa2-40cd-a783-6374259fe810 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:57.939227 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:57.939853 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:57.940135 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:57.940410 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:57.941033 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:57.942922 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:58.008762 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1475/2942] 10.222.0.49 () {60 vars in 1153 bytes} [Mon Sep 26 12:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 12:51:58.013208 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ace6f-e5d1-47d1-b368-6427884cd437 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:58.024160 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ace6f-e5d1-47d1-b368-6427884cd437 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:58.087951 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:58.089000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:58.089365 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:58.089651 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:58.090441 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:58.092398 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:58.177701 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:58.184018 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1468/2943] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Sep 26 12:51:58 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 12:51:58.188141 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:58.199219 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e37ade-4307-488c-b605-80a70c735432 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:58.204479 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:58.205482 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:58.205896 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:58.206302 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:58.207248 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:58.208908 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:58.221617 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1476/2944] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:58.225947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:58.236242 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360de575-ac62-4cf5-b3be-15a7f2a098a0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:58.241350 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:58.242000 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:58.242278 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:58.242552 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] PATH_INFO: `/v3/projects/a4c6122e07c544c8814dc0fa445db921/users/289fb04f6ff0411999cff19a6a8165f0/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:58.257414 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c6122e07c544c8814dc0fa445db921, user_id=289fb04f6ff0411999cff19a6a8165f0, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:58.261992 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:58.338694 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1469/2945] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:58 2022] PUT /identity/v3/projects/a4c6122e07c544c8814dc0fa445db921/users/289fb04f6ff0411999cff19a6a8165f0/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:58.342809 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:58.353930 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f047-b5ae-457d-abf2-8185107472bb admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:58.384129 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:51:58.412306 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8e439-3672-4de2-a74b-731821f60fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:58.412910 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e439-3672-4de2-a74b-731821f60fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:58.413190 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e439-3672-4de2-a74b-731821f60fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:58.413462 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e439-3672-4de2-a74b-731821f60fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:58.414130 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8e439-3672-4de2-a74b-731821f60fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:58.415745 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8e439-3672-4de2-a74b-731821f60fd6 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:58.425850 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1477/2946] 10.222.0.49 () {58 vars in 1122 bytes} [Mon Sep 26 12:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 12:51:58.429804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:58.440550 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a334e-11ee-4bc6-839c-6bf7d5553e01 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:58.445133 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:58.445780 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:58.446063 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:58.446333 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] PATH_INFO: `/v3/projects/a4c6122e07c544c8814dc0fa445db921/users/289fb04f6ff0411999cff19a6a8165f0/roles/6e8e99de087147e09c760c84a9b30604` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:58.448309 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c6122e07c544c8814dc0fa445db921, user_id=289fb04f6ff0411999cff19a6a8165f0, role_id=6e8e99de087147e09c760c84a9b30604)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:58.450903 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:58.462131 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1470/2947] 10.222.0.49 () {60 vars in 1483 bytes} [Mon Sep 26 12:51:58 2022] PUT /identity/v3/projects/a4c6122e07c544c8814dc0fa445db921/users/289fb04f6ff0411999cff19a6a8165f0/roles/6e8e99de087147e09c760c84a9b30604 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:51:58.473305 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:58.473588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:58.473859 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:58.504312 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] MFA Rules not processed for user `289fb04f6ff0411999cff19a6a8165f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:51:58.505534 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:58.587272 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1478/2948] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:51:58.599254 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:51:58.601088 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:51:58.659993 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4188a-fc3f-4981-98b8-af624fe5324f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:51:58.663816 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:51:58.664469 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:51:58.664746 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:51:58.665076 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:51:58.723184 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:51:58.724574 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:51:58.733713 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1471/2949] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:51:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:52:00.765913 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:00.769208 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:52:00.780724 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091a0df-47d2-4a70-a4ff-100170b20c6a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:00.784506 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:00.785102 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:00.785383 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:00.785657 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:00.842119 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:00.843609 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:00.854766 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1479/2950] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:52:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:52:02.381253 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:02.390336 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a1155-2dbc-4ed0-8f3f-6c2c2879023c service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:02.394202 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99510588-b948-4bab-911c-02b6af50383d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91af8e7c2dcd41e480e1b1a086ba2688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:02.394804 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510588-b948-4bab-911c-02b6af50383d service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:02.395090 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510588-b948-4bab-911c-02b6af50383d service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:02.395376 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99510588-b948-4bab-911c-02b6af50383d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:02.404384 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99510588-b948-4bab-911c-02b6af50383d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:02.405793 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99510588-b948-4bab-911c-02b6af50383d service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:02.416009 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1472/2951] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:52:07.117733 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:07.172346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:52:07.184363 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3c49-c66f-4c91-b65c-f03ddf46dc5e service cinder] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:07.188949 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:07.190353 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:07.190635 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:07.190911 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] PATH_INFO: `/v3/users/ca45767a8c0d4838bf35e5d94bd92fa5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:07.192087 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca45767a8c0d4838bf35e5d94bd92fa5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:07.193999 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:07.364067 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca45767a8c0d4838bf35e5d94bd92fa5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:07.364703 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca45767a8c0d4838bf35e5d94bd92fa5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:07.371797 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca45767a8c0d4838bf35e5d94bd92fa5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:07.385513 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca45767a8c0d4838bf35e5d94bd92fa5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:07.458131 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca45767a8c0d4838bf35e5d94bd92fa5'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:07.464349 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1480/2952] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:52:07 2022] DELETE /identity/v3/users/ca45767a8c0d4838bf35e5d94bd92fa5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:52:07.469008 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:07.475689 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:07.475689 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:07.489343 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] MFA Rules not processed for user `fe7f20c75e5e43198e8f652b576f11c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 12:52:07.490548 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:52:07.549070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1473/2953] 10.222.0.49 () {58 vars in 958 bytes} [Mon Sep 26 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 12:52:07.558824 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:07.560440 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:52:07.619182 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84fd5a-7326-4ab0-acff-df8fb026015c admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:07.622810 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c06385b20074363b3a5f7216947280b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:07.623452 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:07.623739 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:07.624012 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:07.633158 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:07.634889 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:07.644519 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1481/2954] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:52:08.084488 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:08.088276 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:52:08.096961 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:52:08.101947 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbe9b-f0ee-4a24-9250-179f4d8eec67 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:08.106642 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:08.107283 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:08.107590 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:08.107863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] PATH_INFO: `/v3/projects/4449f37d67814de48e649e4c3e68d43e` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:08.108998 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4449f37d67814de48e649e4c3e68d43e)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:08.110923 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:08.248039 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4449f37d67814de48e649e4c3e68d43e', 'request_id': 'req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.332839 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4449f37d67814de48e649e4c3e68d43e', 'request_id': 'req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.339509 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4449f37d67814de48e649e4c3e68d43e', 'request_id': 'req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.351316 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] The token cache is being invalidate because project 4449f37d67814de48e649e4c3e68d43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:52:08.351644 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.352543 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.354079 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1474/2955] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:52:08 2022] DELETE /identity/v3/projects/4449f37d67814de48e649e4c3e68d43e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:52:08.358120 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:08.368496 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e22568-fe6a-4e4e-88de-466cabc72a41 service neutron] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:08.427531 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:08.428164 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:08.428447 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:08.428723 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] PATH_INFO: `/v3/users/52394712bcba40c8a61dc614d840f4e6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:08.429858 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52394712bcba40c8a61dc614d840f4e6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:08.431815 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:08.448214 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:52:08.582246 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52394712bcba40c8a61dc614d840f4e6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.583228 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52394712bcba40c8a61dc614d840f4e6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.591083 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52394712bcba40c8a61dc614d840f4e6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.603677 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52394712bcba40c8a61dc614d840f4e6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.697008 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52394712bcba40c8a61dc614d840f4e6'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:08.703623 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1482/2956] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:52:08 2022] DELETE /identity/v3/users/52394712bcba40c8a61dc614d840f4e6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:52:09.198887 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:09.201341 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:52:09.218066 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584886b-4b4b-4ee1-b55a-b23c779f6ca0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:09.291541 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:09.292180 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:09.292463 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:09.292737 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] PATH_INFO: `/v3/projects/4c12da657c16493aa87a0c960bebda7b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:09.293863 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c12da657c16493aa87a0c960bebda7b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:09.296295 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:09.517929 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c12da657c16493aa87a0c960bebda7b', 'request_id': 'req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.590014 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c12da657c16493aa87a0c960bebda7b', 'request_id': 'req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.599897 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c12da657c16493aa87a0c960bebda7b', 'request_id': 'req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.613070 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] The token cache is being invalidate because project 4c12da657c16493aa87a0c960bebda7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:52:09.613366 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.614027 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.615553 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1475/2957] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:52:09 2022] DELETE /identity/v3/projects/4c12da657c16493aa87a0c960bebda7b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:52:09.619639 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:09.621054 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:52:09.634257 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c83f6-6a53-489a-b0b1-eaefe68de295 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:09.691417 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:09.692049 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:09.692329 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:09.692632 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] PATH_INFO: `/v3/users/289fb04f6ff0411999cff19a6a8165f0` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:09.693765 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=289fb04f6ff0411999cff19a6a8165f0)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:09.695726 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:09.849405 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289fb04f6ff0411999cff19a6a8165f0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.849993 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289fb04f6ff0411999cff19a6a8165f0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.856971 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289fb04f6ff0411999cff19a6a8165f0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.869298 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289fb04f6ff0411999cff19a6a8165f0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.956460 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289fb04f6ff0411999cff19a6a8165f0'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:09.963085 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1483/2958] 10.222.0.49 () {58 vars in 1224 bytes} [Mon Sep 26 12:52:09 2022] DELETE /identity/v3/users/289fb04f6ff0411999cff19a6a8165f0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:52:10.368561 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:52:10.370052 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:52:10.385379 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757a6ab-c44c-4d3f-8c09-eae86fe9601b admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:52:10.398616 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:52:10.445514 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe7f20c75e5e43198e8f652b576f11c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72cdb02c523548e3a44964d7bf629c5b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:52:10.446153 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:52:10.446432 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:52:10.446705 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] PATH_INFO: `/v3/projects/a4c6122e07c544c8814dc0fa445db921` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:52:10.447912 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c6122e07c544c8814dc0fa445db921)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:52:10.449854 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:52:10.572751 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c6122e07c544c8814dc0fa445db921', 'request_id': 'req-5ef2bfb1-a265-4e2b-9584-7c03a6268504'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:10.633825 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c6122e07c544c8814dc0fa445db921', 'request_id': 'req-5ef2bfb1-a265-4e2b-9584-7c03a6268504'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:10.640487 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c6122e07c544c8814dc0fa445db921', 'request_id': 'req-5ef2bfb1-a265-4e2b-9584-7c03a6268504'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:10.652417 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] The token cache is being invalidate because project a4c6122e07c544c8814dc0fa445db921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81702) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 12:52:10.652638 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:10.653297 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-5ef2bfb1-a265-4e2b-9584-7c03a6268504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 12:52:10.654774 dv-cinder-827624-1-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1476/2959] 10.222.0.49 () {58 vars in 1233 bytes} [Mon Sep 26 12:52:10 2022] DELETE /identity/v3/projects/a4c6122e07c544c8814dc0fa445db921 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 12:52:19.959361 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:DELETE=19,keystone:SELECT=73,keystone:INSERT=2 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:52:20.649164 dv-cinder-827624-1-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 12:53:37.551680 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 12:53:37.553149 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:53:37.686094 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3d26-543e-4013-aa0b-92a971a8c9ce admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 12:53:37.747063 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438357c6-09f9-45cb-9f02-d7bf451ee428 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba94572d0db5429ab9275319ef2ee403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc54ce22d0674d7f9774cc34d11b93cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 12:53:37.747708 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438357c6-09f9-45cb-9f02-d7bf451ee428 service placement] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 12:53:37.747983 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438357c6-09f9-45cb-9f02-d7bf451ee428 service placement] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 12:53:37.748253 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438357c6-09f9-45cb-9f02-d7bf451ee428 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 12:53:37.749986 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-438357c6-09f9-45cb-9f02-d7bf451ee428 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 12:53:37.762652 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438357c6-09f9-45cb-9f02-d7bf451ee428 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 12:53:37.765588 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438357c6-09f9-45cb-9f02-d7bf451ee428 service placement] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 12:53:37.774863 dv-cinder-827624-1-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1484/2960] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Sep 26 12:53:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 12:53:47.770346 dv-cinder-827624-1-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=78 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}